&&&& RUNNING TensorRT.trtexec [TensorRT v8601] # trtexec --onnx=./encoder-epoch-99-avg-1.onnx --minShapes=x:1x16x80,x_lens:1 --optShapes=x:4x512x80,x_lens:4 --maxShapes=x:8x2000x80,x_lens:8 --fp16 --skipInference --verbose --saveEngine=./encoder.trt90.plan [07/20/2023-07:25:21] [I] === Model Options === [07/20/2023-07:25:21] [I] Format: ONNX [07/20/2023-07:25:21] [I] Model: ./encoder-epoch-99-avg-1.onnx [07/20/2023-07:25:21] [I] Output: [07/20/2023-07:25:21] [I] === Build Options === [07/20/2023-07:25:21] [I] Max batch: explicit batch [07/20/2023-07:25:21] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [07/20/2023-07:25:21] [I] minTiming: 1 [07/20/2023-07:25:21] [I] avgTiming: 8 [07/20/2023-07:25:21] [I] Precision: FP32+FP16 [07/20/2023-07:25:21] [I] LayerPrecisions: [07/20/2023-07:25:21] [I] Layer Device Types: [07/20/2023-07:25:21] [I] Calibration: [07/20/2023-07:25:21] [I] Refit: Disabled [07/20/2023-07:25:21] [I] Version Compatible: Disabled [07/20/2023-07:25:21] [I] TensorRT runtime: full [07/20/2023-07:25:21] [I] Lean DLL Path: [07/20/2023-07:25:21] [I] Tempfile Controls: { in_memory: allow, temporary: allow } [07/20/2023-07:25:21] [I] Exclude Lean Runtime: Disabled [07/20/2023-07:25:21] [I] Sparsity: Disabled [07/20/2023-07:25:21] [I] Safe mode: Disabled [07/20/2023-07:25:21] [I] Build DLA standalone loadable: Disabled [07/20/2023-07:25:21] [I] Allow GPU fallback for DLA: Disabled [07/20/2023-07:25:21] [I] DirectIO mode: Disabled [07/20/2023-07:25:21] [I] Restricted mode: Disabled [07/20/2023-07:25:21] [I] Skip inference: Enabled [07/20/2023-07:25:21] [I] Save engine: ./encoder.trt90.plan [07/20/2023-07:25:21] [I] Load engine: [07/20/2023-07:25:21] [I] Profiling verbosity: 0 [07/20/2023-07:25:21] [I] Tactic sources: Using default tactic sources [07/20/2023-07:25:21] [I] timingCacheMode: local [07/20/2023-07:25:21] [I] timingCacheFile: [07/20/2023-07:25:21] [I] Heuristic: Disabled [07/20/2023-07:25:21] [I] Preview Features: Use default preview flags. [07/20/2023-07:25:21] [I] MaxAuxStreams: -1 [07/20/2023-07:25:21] [I] BuilderOptimizationLevel: -1 [07/20/2023-07:25:21] [I] Input(s)s format: fp32:CHW [07/20/2023-07:25:21] [I] Output(s)s format: fp32:CHW [07/20/2023-07:25:21] [I] Input build shape: x=1x16x80+4x512x80+8x2000x80 [07/20/2023-07:25:21] [I] Input build shape: x_lens=1+4+8 [07/20/2023-07:25:21] [I] Input calibration shapes: model [07/20/2023-07:25:21] [I] === System Options === [07/20/2023-07:25:21] [I] Device: 0 [07/20/2023-07:25:21] [I] DLACore: [07/20/2023-07:25:21] [I] Plugins: [07/20/2023-07:25:21] [I] setPluginsToSerialize: [07/20/2023-07:25:21] [I] dynamicPlugins: [07/20/2023-07:25:21] [I] ignoreParsedPluginLibs: 0 [07/20/2023-07:25:21] [I] [07/20/2023-07:25:21] [I] === Inference Options === [07/20/2023-07:25:21] [I] Batch: Explicit [07/20/2023-07:25:21] [I] Input inference shape: x_lens=4 [07/20/2023-07:25:21] [I] Input inference shape: x=4x512x80 [07/20/2023-07:25:21] [I] Iterations: 10 [07/20/2023-07:25:21] [I] Duration: 3s (+ 200ms warm up) [07/20/2023-07:25:21] [I] Sleep time: 0ms [07/20/2023-07:25:21] [I] Idle time: 0ms [07/20/2023-07:25:21] [I] Inference Streams: 1 [07/20/2023-07:25:21] [I] ExposeDMA: Disabled [07/20/2023-07:25:21] [I] Data transfers: Enabled [07/20/2023-07:25:21] [I] Spin-wait: Disabled [07/20/2023-07:25:21] [I] Multithreading: Disabled [07/20/2023-07:25:21] [I] CUDA Graph: Disabled [07/20/2023-07:25:21] [I] Separate profiling: Disabled [07/20/2023-07:25:21] [I] Time Deserialize: Disabled [07/20/2023-07:25:21] [I] Time Refit: Disabled [07/20/2023-07:25:21] [I] NVTX verbosity: 0 [07/20/2023-07:25:21] [I] Persistent Cache Ratio: 0 [07/20/2023-07:25:21] [I] Inputs: [07/20/2023-07:25:21] [I] === Reporting Options === [07/20/2023-07:25:21] [I] Verbose: Enabled [07/20/2023-07:25:21] [I] Averages: 10 inferences [07/20/2023-07:25:21] [I] Percentiles: 90,95,99 [07/20/2023-07:25:21] [I] Dump refittable layers:Disabled [07/20/2023-07:25:21] [I] Dump output: Disabled [07/20/2023-07:25:21] [I] Profile: Disabled [07/20/2023-07:25:21] [I] Export timing to JSON file: [07/20/2023-07:25:21] [I] Export output to JSON file: [07/20/2023-07:25:21] [I] Export profile to JSON file: [07/20/2023-07:25:21] [I] [07/20/2023-07:25:21] [I] === Device Information === [07/20/2023-07:25:21] [I] Selected Device: NVIDIA A10 [07/20/2023-07:25:21] [I] Compute Capability: 8.6 [07/20/2023-07:25:21] [I] SMs: 72 [07/20/2023-07:25:21] [I] Device Global Memory: 22723 MiB [07/20/2023-07:25:21] [I] Shared Memory per SM: 100 KiB [07/20/2023-07:25:21] [I] Memory Bus Width: 384 bits (ECC enabled) [07/20/2023-07:25:21] [I] Application Compute Clock Rate: 1.695 GHz [07/20/2023-07:25:21] [I] Application Memory Clock Rate: 6.251 GHz [07/20/2023-07:25:21] [I] [07/20/2023-07:25:21] [I] Note: The application clock rates do not reflect the actual clock rates that the GPU is currently running at. [07/20/2023-07:25:21] [I] [07/20/2023-07:25:21] [I] TensorRT version: 8.6.1 [07/20/2023-07:25:21] [I] Loading standard plugins [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 2 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ModulatedDeformConv2d version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Proposal version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ROIAlign_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::Split version 1 [07/20/2023-07:25:21] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [07/20/2023-07:25:21] [I] [TRT] [MemUsageChange] Init CUDA: CPU +2, GPU +0, now: CPU 19, GPU 233 (MiB) [07/20/2023-07:25:21] [V] [TRT] Trying to load shared library libnvinfer_builder_resource.so.8.6.1 [07/20/2023-07:25:21] [V] [TRT] Loaded shared library libnvinfer_builder_resource.so.8.6.1 [07/20/2023-07:25:30] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +1443, GPU +268, now: CPU 1539, GPU 501 (MiB) [07/20/2023-07:25:30] [V] [TRT] CUDA lazy loading is enabled. [07/20/2023-07:25:30] [I] Start parsing network model. [07/20/2023-07:25:30] [I] [TRT] ---------------------------------------------------------------- [07/20/2023-07:25:30] [I] [TRT] Input filename: ./encoder-epoch-99-avg-1.onnx [07/20/2023-07:25:30] [I] [TRT] ONNX IR version: 0.0.7 [07/20/2023-07:25:30] [I] [TRT] Opset version: 13 [07/20/2023-07:25:30] [I] [TRT] Producer name: pytorch [07/20/2023-07:25:30] [I] [TRT] Producer version: 2.1.0 [07/20/2023-07:25:30] [I] [TRT] Domain: [07/20/2023-07:25:30] [I] [TRT] Model version: 0 [07/20/2023-07:25:30] [I] [TRT] Doc string: [07/20/2023-07:25:30] [I] [TRT] ---------------------------------------------------------------- [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 2 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ModulatedDeformConv2d version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ROIAlign_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::Split version 1 [07/20/2023-07:25:30] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [07/20/2023-07:25:30] [V] [TRT] Adding network input: x with dtype: float32, dimensions: (-1, -1, 80) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: x for ONNX tensor: x [07/20/2023-07:25:30] [V] [TRT] Adding network input: x_lens with dtype: int32, dimensions: (-1) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: x_lens for ONNX tensor: x_lens [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.0.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.0.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.4.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.4.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.7.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.conv.7.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.pointwise_conv1.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.pointwise_conv1.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.pointwise_conv2.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.convnext.pointwise_conv2.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.out.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.out_norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_embed.out_norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.0.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.1.out_combiner.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.2.out_combiner.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.encoder.layers.3.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.3.out_combiner.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.4.out_combiner.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder.encoders.5.out_combiner.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Importing initializer: encoder_proj.bias [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9177 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9180 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9187 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9194 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9195 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9196 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9200 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9201 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9203 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9204 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9205 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9206 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9207 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9208 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9210 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9211 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9212 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9213 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9214 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9215 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9222 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9229 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9230 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9231 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9235 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9236 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9238 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9239 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9240 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9241 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9242 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9243 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9245 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9246 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9247 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9248 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9249 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9254 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9256 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9263 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9270 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9271 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9272 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9276 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9277 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9279 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9280 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9281 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9282 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9283 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9284 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9286 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9287 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9288 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9289 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9290 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9291 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9298 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9305 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9306 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9307 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9311 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9312 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9314 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9315 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9316 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9317 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9318 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9319 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9321 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9322 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9323 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9324 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9325 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9333 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9335 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9342 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9349 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9350 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9351 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9355 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9356 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9358 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9359 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9360 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9361 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9362 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9363 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9365 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9366 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9367 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9368 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9369 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9370 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9377 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9384 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9385 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9386 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9390 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9391 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9393 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9394 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9395 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9396 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9397 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9398 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9400 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9401 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9402 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9403 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9404 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9405 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9412 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9419 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9420 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9421 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9425 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9426 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9428 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9429 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9430 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9431 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9432 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9433 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9435 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9436 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9437 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9438 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9439 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9447 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9449 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9456 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9463 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9464 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9465 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9469 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9470 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9472 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9473 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9474 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9475 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9476 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9477 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9479 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9480 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9481 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9482 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9483 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9484 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9491 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9498 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9499 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9500 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9504 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9505 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9507 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9508 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9509 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9510 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9511 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9512 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9514 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9515 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9516 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9517 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9518 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9519 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9526 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9533 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9534 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9535 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9539 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9540 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9542 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9543 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9544 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9545 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9546 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9547 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9549 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9550 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9551 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9552 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9553 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9554 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9561 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9568 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9569 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9570 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9574 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9575 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9577 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9578 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9579 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9580 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9581 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9582 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9584 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9585 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9586 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9587 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9588 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9596 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9598 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9605 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9612 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9613 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9614 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9618 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9619 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9621 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9622 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9623 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9624 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9625 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9626 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9628 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9629 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9630 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9631 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9632 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9633 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9640 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9647 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9648 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9649 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9653 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9654 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9656 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9657 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9658 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9659 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9660 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9661 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9663 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9664 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9665 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9666 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9667 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9668 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9675 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9682 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9683 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9684 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9688 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9689 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9691 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9692 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9693 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9694 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9695 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9696 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9698 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9699 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9700 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9701 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9702 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9710 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9712 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9719 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9726 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9727 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9728 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9732 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9733 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9735 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9736 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9737 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9738 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9739 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9740 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9742 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9743 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9744 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9745 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9746 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9747 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9754 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9761 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9762 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9763 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9767 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9768 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9770 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9771 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9772 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9773 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9774 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9775 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9777 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9778 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9779 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9780 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9781 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::Softmax_9789 [07/20/2023-07:25:30] [V] [TRT] Importing initializer: onnx::MatMul_9790 [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_0 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_0 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_0 [Constant] outputs: [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant [Constant] outputs: [/encoder_embed/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: x [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze [Unsqueeze] inputs: [x -> (-1, -1, 80)[FLOAT]], [/encoder_embed/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _, 80), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Unsqueeze for ONNX node: /encoder_embed/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Unsqueeze_output_0 for ONNX tensor: /encoder_embed/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze [Unsqueeze] outputs: [/encoder_embed/Unsqueeze_output_0 -> (-1, 1, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/0/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.0.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.0.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/0/Conv [Conv] inputs: [/encoder_embed/Unsqueeze_output_0 -> (-1, 1, -1, 80)[FLOAT]], [encoder_embed.conv.0.weight -> (8, 1, 3, 3)[FLOAT]], [encoder_embed.conv.0.bias -> (8)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 1, -1, 80) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/0/Conv for ONNX node: /encoder_embed/conv/0/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 1), postpadding: (0, 1), dilations: (1, 1), numOutputs: 8 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 8, -1, 80) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/0/Conv_output_0 for ONNX tensor: /encoder_embed/conv/0/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/0/Conv [Conv] outputs: [/encoder_embed/conv/0/Conv_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant [Constant] outputs: [/encoder_embed/conv/3/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/0/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub [Sub] inputs: [/encoder_embed/conv/0/Conv_output_0 -> (-1, 8, -1, 80)[FLOAT]], [/encoder_embed/conv/3/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_output_0 for ONNX node: /encoder_embed/conv/3/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Sub for ONNX node: /encoder_embed/conv/3/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Sub_output_0 for ONNX tensor: /encoder_embed/conv/3/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub [Sub] outputs: [/encoder_embed/conv/3/Sub_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_1 [Constant] outputs: [/encoder_embed/conv/3/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Max [Max] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Max [Max] inputs: [/encoder_embed/conv/3/Constant_1_output_0 -> ()[FLOAT]], [/encoder_embed/conv/3/Sub_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_1_output_0 for ONNX node: /encoder_embed/conv/3/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Max for ONNX node: /encoder_embed/conv/3/Max [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Max_output_0 for ONNX tensor: /encoder_embed/conv/3/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Max [Max] outputs: [/encoder_embed/conv/3/Max_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_2 [Constant] outputs: [/encoder_embed/conv/3/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_1 [Sub] inputs: [/encoder_embed/conv/3/Constant_2_output_0 -> ()[FLOAT]], [/encoder_embed/conv/3/Sub_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_2_output_0 for ONNX node: /encoder_embed/conv/3/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Sub_1 for ONNX node: /encoder_embed/conv/3/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Sub_1_output_0 for ONNX tensor: /encoder_embed/conv/3/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_1 [Sub] outputs: [/encoder_embed/conv/3/Sub_1_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Abs [Abs] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Abs [Abs] inputs: [/encoder_embed/conv/3/Sub_1_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Abs for ONNX node: /encoder_embed/conv/3/Abs [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Abs_output_0 for ONNX tensor: /encoder_embed/conv/3/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Abs [Abs] outputs: [/encoder_embed/conv/3/Abs_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Neg [Neg] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Neg [Neg] inputs: [/encoder_embed/conv/3/Abs_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Neg for ONNX node: /encoder_embed/conv/3/Neg [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Neg_output_0 for ONNX tensor: /encoder_embed/conv/3/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Neg [Neg] outputs: [/encoder_embed/conv/3/Neg_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Exp [Exp] inputs: [/encoder_embed/conv/3/Neg_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Exp for ONNX node: /encoder_embed/conv/3/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Exp_output_0 for ONNX tensor: /encoder_embed/conv/3/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Exp [Exp] outputs: [/encoder_embed/conv/3/Exp_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_3 [Constant] outputs: [/encoder_embed/conv/3/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Add [Add] inputs: [/encoder_embed/conv/3/Constant_3_output_0 -> ()[FLOAT]], [/encoder_embed/conv/3/Exp_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_3_output_0 for ONNX node: /encoder_embed/conv/3/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Add for ONNX node: /encoder_embed/conv/3/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Add_output_0 for ONNX tensor: /encoder_embed/conv/3/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Add [Add] outputs: [/encoder_embed/conv/3/Add_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Log [Log] inputs: [/encoder_embed/conv/3/Add_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Log for ONNX node: /encoder_embed/conv/3/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Log_output_0 for ONNX tensor: /encoder_embed/conv/3/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Log [Log] outputs: [/encoder_embed/conv/3/Log_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Add_1 [Add] inputs: [/encoder_embed/conv/3/Max_output_0 -> (-1, 8, -1, 80)[FLOAT]], [/encoder_embed/conv/3/Log_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Add_1 for ONNX node: /encoder_embed/conv/3/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Add_1_output_0 for ONNX tensor: /encoder_embed/conv/3/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Add_1 [Add] outputs: [/encoder_embed/conv/3/Add_1_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_4 [Constant] outputs: [/encoder_embed/conv/3/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/0/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Mul [Mul] inputs: [/encoder_embed/conv/0/Conv_output_0 -> (-1, 8, -1, 80)[FLOAT]], [/encoder_embed/conv/3/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_4_output_0 for ONNX node: /encoder_embed/conv/3/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Mul for ONNX node: /encoder_embed/conv/3/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Mul_output_0 for ONNX tensor: /encoder_embed/conv/3/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Mul [Mul] outputs: [/encoder_embed/conv/3/Mul_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_2 [Sub] inputs: [/encoder_embed/conv/3/Add_1_output_0 -> (-1, 8, -1, 80)[FLOAT]], [/encoder_embed/conv/3/Mul_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Sub_2 for ONNX node: /encoder_embed/conv/3/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Sub_2_output_0 for ONNX tensor: /encoder_embed/conv/3/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_2 [Sub] outputs: [/encoder_embed/conv/3/Sub_2_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Constant_5 [Constant] outputs: [/encoder_embed/conv/3/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/3/Sub_3 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_3 [Sub] inputs: [/encoder_embed/conv/3/Sub_2_output_0 -> (-1, 8, -1, 80)[FLOAT]], [/encoder_embed/conv/3/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Constant_5_output_0 for ONNX node: /encoder_embed/conv/3/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/3/Sub_3 for ONNX node: /encoder_embed/conv/3/Sub_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/3/Sub_3_output_0 for ONNX tensor: /encoder_embed/conv/3/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/3/Sub_3 [Sub] outputs: [/encoder_embed/conv/3/Sub_3_output_0 -> (-1, 8, -1, 80)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/4/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/3/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.4.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.4.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/4/Conv [Conv] inputs: [/encoder_embed/conv/3/Sub_3_output_0 -> (-1, 8, -1, 80)[FLOAT]], [encoder_embed.conv.4.weight -> (32, 8, 3, 3)[FLOAT]], [encoder_embed.conv.4.bias -> (32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 8, -1, 80) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/4/Conv for ONNX node: /encoder_embed/conv/4/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 32, -1, 39) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/4/Conv_output_0 for ONNX tensor: /encoder_embed/conv/4/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/4/Conv [Conv] outputs: [/encoder_embed/conv/4/Conv_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant [Constant] outputs: [/encoder_embed/conv/6/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/4/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub [Sub] inputs: [/encoder_embed/conv/4/Conv_output_0 -> (-1, 32, -1, 39)[FLOAT]], [/encoder_embed/conv/6/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_output_0 for ONNX node: /encoder_embed/conv/6/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Sub for ONNX node: /encoder_embed/conv/6/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Sub_output_0 for ONNX tensor: /encoder_embed/conv/6/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub [Sub] outputs: [/encoder_embed/conv/6/Sub_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_1 [Constant] outputs: [/encoder_embed/conv/6/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Max [Max] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Max [Max] inputs: [/encoder_embed/conv/6/Constant_1_output_0 -> ()[FLOAT]], [/encoder_embed/conv/6/Sub_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_1_output_0 for ONNX node: /encoder_embed/conv/6/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Max for ONNX node: /encoder_embed/conv/6/Max [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Max_output_0 for ONNX tensor: /encoder_embed/conv/6/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Max [Max] outputs: [/encoder_embed/conv/6/Max_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_2 [Constant] outputs: [/encoder_embed/conv/6/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_1 [Sub] inputs: [/encoder_embed/conv/6/Constant_2_output_0 -> ()[FLOAT]], [/encoder_embed/conv/6/Sub_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_2_output_0 for ONNX node: /encoder_embed/conv/6/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Sub_1 for ONNX node: /encoder_embed/conv/6/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Sub_1_output_0 for ONNX tensor: /encoder_embed/conv/6/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_1 [Sub] outputs: [/encoder_embed/conv/6/Sub_1_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Abs [Abs] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Abs [Abs] inputs: [/encoder_embed/conv/6/Sub_1_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Abs for ONNX node: /encoder_embed/conv/6/Abs [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Abs_output_0 for ONNX tensor: /encoder_embed/conv/6/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Abs [Abs] outputs: [/encoder_embed/conv/6/Abs_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Neg [Neg] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Neg [Neg] inputs: [/encoder_embed/conv/6/Abs_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Neg for ONNX node: /encoder_embed/conv/6/Neg [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Neg_output_0 for ONNX tensor: /encoder_embed/conv/6/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Neg [Neg] outputs: [/encoder_embed/conv/6/Neg_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Exp [Exp] inputs: [/encoder_embed/conv/6/Neg_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Exp for ONNX node: /encoder_embed/conv/6/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Exp_output_0 for ONNX tensor: /encoder_embed/conv/6/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Exp [Exp] outputs: [/encoder_embed/conv/6/Exp_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_3 [Constant] outputs: [/encoder_embed/conv/6/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Add [Add] inputs: [/encoder_embed/conv/6/Constant_3_output_0 -> ()[FLOAT]], [/encoder_embed/conv/6/Exp_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_3_output_0 for ONNX node: /encoder_embed/conv/6/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Add for ONNX node: /encoder_embed/conv/6/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Add_output_0 for ONNX tensor: /encoder_embed/conv/6/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Add [Add] outputs: [/encoder_embed/conv/6/Add_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Log [Log] inputs: [/encoder_embed/conv/6/Add_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Log for ONNX node: /encoder_embed/conv/6/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Log_output_0 for ONNX tensor: /encoder_embed/conv/6/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Log [Log] outputs: [/encoder_embed/conv/6/Log_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Add_1 [Add] inputs: [/encoder_embed/conv/6/Max_output_0 -> (-1, 32, -1, 39)[FLOAT]], [/encoder_embed/conv/6/Log_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Add_1 for ONNX node: /encoder_embed/conv/6/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Add_1_output_0 for ONNX tensor: /encoder_embed/conv/6/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Add_1 [Add] outputs: [/encoder_embed/conv/6/Add_1_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_4 [Constant] outputs: [/encoder_embed/conv/6/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/4/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Mul [Mul] inputs: [/encoder_embed/conv/4/Conv_output_0 -> (-1, 32, -1, 39)[FLOAT]], [/encoder_embed/conv/6/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_4_output_0 for ONNX node: /encoder_embed/conv/6/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Mul for ONNX node: /encoder_embed/conv/6/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Mul_output_0 for ONNX tensor: /encoder_embed/conv/6/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Mul [Mul] outputs: [/encoder_embed/conv/6/Mul_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_2 [Sub] inputs: [/encoder_embed/conv/6/Add_1_output_0 -> (-1, 32, -1, 39)[FLOAT]], [/encoder_embed/conv/6/Mul_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Sub_2 for ONNX node: /encoder_embed/conv/6/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Sub_2_output_0 for ONNX tensor: /encoder_embed/conv/6/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_2 [Sub] outputs: [/encoder_embed/conv/6/Sub_2_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Constant_5 [Constant] outputs: [/encoder_embed/conv/6/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/6/Sub_3 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_3 [Sub] inputs: [/encoder_embed/conv/6/Sub_2_output_0 -> (-1, 32, -1, 39)[FLOAT]], [/encoder_embed/conv/6/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Constant_5_output_0 for ONNX node: /encoder_embed/conv/6/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/6/Sub_3 for ONNX node: /encoder_embed/conv/6/Sub_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/6/Sub_3_output_0 for ONNX tensor: /encoder_embed/conv/6/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/6/Sub_3 [Sub] outputs: [/encoder_embed/conv/6/Sub_3_output_0 -> (-1, 32, -1, 39)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/7/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/6/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.7.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.conv.7.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/7/Conv [Conv] inputs: [/encoder_embed/conv/6/Sub_3_output_0 -> (-1, 32, -1, 39)[FLOAT]], [encoder_embed.conv.7.weight -> (128, 32, 3, 3)[FLOAT]], [encoder_embed.conv.7.bias -> (128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 32, -1, 39) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/7/Conv for ONNX node: /encoder_embed/conv/7/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (3, 3), strides: (1, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 128, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/7/Conv_output_0 for ONNX tensor: /encoder_embed/conv/7/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/7/Conv [Conv] outputs: [/encoder_embed/conv/7/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant [Constant] outputs: [/encoder_embed/conv/9/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/7/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub [Sub] inputs: [/encoder_embed/conv/7/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/conv/9/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_output_0 for ONNX node: /encoder_embed/conv/9/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Sub for ONNX node: /encoder_embed/conv/9/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Sub_output_0 for ONNX tensor: /encoder_embed/conv/9/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub [Sub] outputs: [/encoder_embed/conv/9/Sub_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_1 [Constant] outputs: [/encoder_embed/conv/9/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Max [Max] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Max [Max] inputs: [/encoder_embed/conv/9/Constant_1_output_0 -> ()[FLOAT]], [/encoder_embed/conv/9/Sub_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_1_output_0 for ONNX node: /encoder_embed/conv/9/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Max for ONNX node: /encoder_embed/conv/9/Max [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Max_output_0 for ONNX tensor: /encoder_embed/conv/9/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Max [Max] outputs: [/encoder_embed/conv/9/Max_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_2 [Constant] outputs: [/encoder_embed/conv/9/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_1 [Sub] inputs: [/encoder_embed/conv/9/Constant_2_output_0 -> ()[FLOAT]], [/encoder_embed/conv/9/Sub_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_2_output_0 for ONNX node: /encoder_embed/conv/9/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Sub_1 for ONNX node: /encoder_embed/conv/9/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Sub_1_output_0 for ONNX tensor: /encoder_embed/conv/9/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_1 [Sub] outputs: [/encoder_embed/conv/9/Sub_1_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Abs [Abs] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Abs [Abs] inputs: [/encoder_embed/conv/9/Sub_1_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Abs for ONNX node: /encoder_embed/conv/9/Abs [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Abs_output_0 for ONNX tensor: /encoder_embed/conv/9/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Abs [Abs] outputs: [/encoder_embed/conv/9/Abs_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Neg [Neg] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Neg [Neg] inputs: [/encoder_embed/conv/9/Abs_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Neg for ONNX node: /encoder_embed/conv/9/Neg [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Neg_output_0 for ONNX tensor: /encoder_embed/conv/9/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Neg [Neg] outputs: [/encoder_embed/conv/9/Neg_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Exp [Exp] inputs: [/encoder_embed/conv/9/Neg_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Exp for ONNX node: /encoder_embed/conv/9/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Exp_output_0 for ONNX tensor: /encoder_embed/conv/9/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Exp [Exp] outputs: [/encoder_embed/conv/9/Exp_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_3 [Constant] outputs: [/encoder_embed/conv/9/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Add [Add] inputs: [/encoder_embed/conv/9/Constant_3_output_0 -> ()[FLOAT]], [/encoder_embed/conv/9/Exp_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_3_output_0 for ONNX node: /encoder_embed/conv/9/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Add for ONNX node: /encoder_embed/conv/9/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Add_output_0 for ONNX tensor: /encoder_embed/conv/9/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Add [Add] outputs: [/encoder_embed/conv/9/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Log [Log] inputs: [/encoder_embed/conv/9/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Log for ONNX node: /encoder_embed/conv/9/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Log_output_0 for ONNX tensor: /encoder_embed/conv/9/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Log [Log] outputs: [/encoder_embed/conv/9/Log_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Add_1 [Add] inputs: [/encoder_embed/conv/9/Max_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/conv/9/Log_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Add_1 for ONNX node: /encoder_embed/conv/9/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Add_1_output_0 for ONNX tensor: /encoder_embed/conv/9/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Add_1 [Add] outputs: [/encoder_embed/conv/9/Add_1_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_4 [Constant] outputs: [/encoder_embed/conv/9/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/7/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Mul [Mul] inputs: [/encoder_embed/conv/7/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/conv/9/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_4_output_0 for ONNX node: /encoder_embed/conv/9/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Mul for ONNX node: /encoder_embed/conv/9/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Mul_output_0 for ONNX tensor: /encoder_embed/conv/9/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Mul [Mul] outputs: [/encoder_embed/conv/9/Mul_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_2 [Sub] inputs: [/encoder_embed/conv/9/Add_1_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/conv/9/Mul_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Sub_2 for ONNX node: /encoder_embed/conv/9/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Sub_2_output_0 for ONNX tensor: /encoder_embed/conv/9/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_2 [Sub] outputs: [/encoder_embed/conv/9/Sub_2_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Constant_5 [Constant] outputs: [/encoder_embed/conv/9/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/conv/9/Sub_3 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_3 [Sub] inputs: [/encoder_embed/conv/9/Sub_2_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/conv/9/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Constant_5_output_0 for ONNX node: /encoder_embed/conv/9/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/conv/9/Sub_3 for ONNX node: /encoder_embed/conv/9/Sub_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/conv/9/Sub_3_output_0 for ONNX tensor: /encoder_embed/conv/9/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/conv/9/Sub_3 [Sub] outputs: [/encoder_embed/conv/9/Sub_3_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/depthwise_conv/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv [Conv] inputs: [/encoder_embed/conv/9/Sub_3_output_0 -> (-1, 128, -1, 19)[FLOAT]], [encoder_embed.convnext.depthwise_conv.weight -> (128, 1, 7, 7)[FLOAT]], [encoder_embed.convnext.depthwise_conv.bias -> (128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 128, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/depthwise_conv/Conv for ONNX node: /encoder_embed/convnext/depthwise_conv/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (7, 7), strides: (1, 1), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 128 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 128, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder_embed/convnext/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv [Conv] outputs: [/encoder_embed/convnext/depthwise_conv/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/pointwise_conv1/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.pointwise_conv1.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.pointwise_conv1.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv [Conv] inputs: [/encoder_embed/convnext/depthwise_conv/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [encoder_embed.convnext.pointwise_conv1.weight -> (384, 128, 1, 1)[FLOAT]], [encoder_embed.convnext.pointwise_conv1.bias -> (384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 128, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/pointwise_conv1/Conv for ONNX node: /encoder_embed/convnext/pointwise_conv1/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/pointwise_conv1/Conv_output_0 for ONNX tensor: /encoder_embed/convnext/pointwise_conv1/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv [Conv] outputs: [/encoder_embed/convnext/pointwise_conv1/Conv_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant [Constant] outputs: [/encoder_embed/convnext/activation/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/pointwise_conv1/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub [Sub] inputs: [/encoder_embed/convnext/pointwise_conv1/Conv_output_0 -> (-1, 384, -1, 19)[FLOAT]], [/encoder_embed/convnext/activation/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Sub for ONNX node: /encoder_embed/convnext/activation/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Sub_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub [Sub] outputs: [/encoder_embed/convnext/activation/Sub_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_1 [Constant] outputs: [/encoder_embed/convnext/activation/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Max [Max] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Max [Max] inputs: [/encoder_embed/convnext/activation/Constant_1_output_0 -> ()[FLOAT]], [/encoder_embed/convnext/activation/Sub_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_1_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Max for ONNX node: /encoder_embed/convnext/activation/Max [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Max_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Max [Max] outputs: [/encoder_embed/convnext/activation/Max_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_2 [Constant] outputs: [/encoder_embed/convnext/activation/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_1 [Sub] inputs: [/encoder_embed/convnext/activation/Constant_2_output_0 -> ()[FLOAT]], [/encoder_embed/convnext/activation/Sub_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_2_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Sub_1 for ONNX node: /encoder_embed/convnext/activation/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Sub_1_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_1 [Sub] outputs: [/encoder_embed/convnext/activation/Sub_1_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Abs [Abs] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Abs [Abs] inputs: [/encoder_embed/convnext/activation/Sub_1_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Abs for ONNX node: /encoder_embed/convnext/activation/Abs [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Abs_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Abs [Abs] outputs: [/encoder_embed/convnext/activation/Abs_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Neg [Neg] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Abs_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Neg [Neg] inputs: [/encoder_embed/convnext/activation/Abs_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Neg for ONNX node: /encoder_embed/convnext/activation/Neg [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Neg_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Neg [Neg] outputs: [/encoder_embed/convnext/activation/Neg_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Neg_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Exp [Exp] inputs: [/encoder_embed/convnext/activation/Neg_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Exp for ONNX node: /encoder_embed/convnext/activation/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Exp_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Exp [Exp] outputs: [/encoder_embed/convnext/activation/Exp_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_3 [Constant] outputs: [/encoder_embed/convnext/activation/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Add [Add] inputs: [/encoder_embed/convnext/activation/Constant_3_output_0 -> ()[FLOAT]], [/encoder_embed/convnext/activation/Exp_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_3_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Add for ONNX node: /encoder_embed/convnext/activation/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Add_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Add [Add] outputs: [/encoder_embed/convnext/activation/Add_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Log [Log] inputs: [/encoder_embed/convnext/activation/Add_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Log for ONNX node: /encoder_embed/convnext/activation/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Log_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Log [Log] outputs: [/encoder_embed/convnext/activation/Log_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Max_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Add_1 [Add] inputs: [/encoder_embed/convnext/activation/Max_output_0 -> (-1, 384, -1, 19)[FLOAT]], [/encoder_embed/convnext/activation/Log_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Add_1 for ONNX node: /encoder_embed/convnext/activation/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Add_1_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Add_1 [Add] outputs: [/encoder_embed/convnext/activation/Add_1_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_4 [Constant] outputs: [/encoder_embed/convnext/activation/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/pointwise_conv1/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Mul [Mul] inputs: [/encoder_embed/convnext/pointwise_conv1/Conv_output_0 -> (-1, 384, -1, 19)[FLOAT]], [/encoder_embed/convnext/activation/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_4_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Mul for ONNX node: /encoder_embed/convnext/activation/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Mul_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Mul [Mul] outputs: [/encoder_embed/convnext/activation/Mul_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_2 [Sub] inputs: [/encoder_embed/convnext/activation/Add_1_output_0 -> (-1, 384, -1, 19)[FLOAT]], [/encoder_embed/convnext/activation/Mul_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Sub_2 for ONNX node: /encoder_embed/convnext/activation/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Sub_2_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_2 [Sub] outputs: [/encoder_embed/convnext/activation/Sub_2_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Constant_5 [Constant] outputs: [/encoder_embed/convnext/activation/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/activation/Sub_3 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_3 [Sub] inputs: [/encoder_embed/convnext/activation/Sub_2_output_0 -> (-1, 384, -1, 19)[FLOAT]], [/encoder_embed/convnext/activation/Constant_5_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Constant_5_output_0 for ONNX node: /encoder_embed/convnext/activation/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/activation/Sub_3 for ONNX node: /encoder_embed/convnext/activation/Sub_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/activation/Sub_3_output_0 for ONNX tensor: /encoder_embed/convnext/activation/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/activation/Sub_3 [Sub] outputs: [/encoder_embed/convnext/activation/Sub_3_output_0 -> (-1, 384, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/pointwise_conv2/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/activation/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.pointwise_conv2.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.convnext.pointwise_conv2.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv [Conv] inputs: [/encoder_embed/convnext/activation/Sub_3_output_0 -> (-1, 384, -1, 19)[FLOAT]], [encoder_embed.convnext.pointwise_conv2.weight -> (128, 384, 1, 1)[FLOAT]], [encoder_embed.convnext.pointwise_conv2.bias -> (128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 384, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/pointwise_conv2/Conv for ONNX node: /encoder_embed/convnext/pointwise_conv2/Conv [07/20/2023-07:25:30] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 128, -1, 19) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/pointwise_conv2/Conv_output_0 for ONNX tensor: /encoder_embed/convnext/pointwise_conv2/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv [Conv] outputs: [/encoder_embed/convnext/pointwise_conv2/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/convnext/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/conv/9/Sub_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/pointwise_conv2/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/Add [Add] inputs: [/encoder_embed/conv/9/Sub_3_output_0 -> (-1, 128, -1, 19)[FLOAT]], [/encoder_embed/convnext/pointwise_conv2/Conv_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/convnext/Add for ONNX node: /encoder_embed/convnext/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/convnext/Add_output_0 for ONNX tensor: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/convnext/Add [Add] outputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape [Shape] inputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Shape for ONNX node: /encoder_embed/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Shape_output_0 for ONNX tensor: /encoder_embed/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape [Shape] outputs: [/encoder_embed/Shape_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_1 [Constant] outputs: [/encoder_embed/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather [Gather] inputs: [/encoder_embed/Shape_output_0 -> (4)[INT32]], [/encoder_embed/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_1_output_0 for ONNX node: /encoder_embed/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Gather for ONNX node: /encoder_embed/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Gather_output_0 for ONNX tensor: /encoder_embed/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather [Gather] outputs: [/encoder_embed/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_1 [Shape] inputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Shape_1 for ONNX node: /encoder_embed/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Shape_1_output_0 for ONNX tensor: /encoder_embed/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_1 [Shape] outputs: [/encoder_embed/Shape_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_2 [Constant] outputs: [/encoder_embed/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_1 [Gather] inputs: [/encoder_embed/Shape_1_output_0 -> (4)[INT32]], [/encoder_embed/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_2_output_0 for ONNX node: /encoder_embed/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Gather_1 for ONNX node: /encoder_embed/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Gather_1_output_0 for ONNX tensor: /encoder_embed/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_1 [Gather] outputs: [/encoder_embed/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_2 [Shape] inputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Shape_2 for ONNX node: /encoder_embed/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Shape_2_output_0 for ONNX tensor: /encoder_embed/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_2 [Shape] outputs: [/encoder_embed/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_3 [Constant] outputs: [/encoder_embed/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_2 [Gather] inputs: [/encoder_embed/Shape_2_output_0 -> (4)[INT32]], [/encoder_embed/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_3_output_0 for ONNX node: /encoder_embed/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Gather_2 for ONNX node: /encoder_embed/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Gather_2_output_0 for ONNX tensor: /encoder_embed/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_2 [Gather] outputs: [/encoder_embed/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_3 [Shape] inputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Shape_3 for ONNX node: /encoder_embed/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Shape_3_output_0 for ONNX tensor: /encoder_embed/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Shape_3 [Shape] outputs: [/encoder_embed/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_4 [Constant] outputs: [/encoder_embed/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_3 [Gather] inputs: [/encoder_embed/Shape_3_output_0 -> (4)[INT32]], [/encoder_embed/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_4_output_0 for ONNX node: /encoder_embed/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Gather_3 for ONNX node: /encoder_embed/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Gather_3_output_0 for ONNX tensor: /encoder_embed/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Gather_3 [Gather] outputs: [/encoder_embed/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/convnext/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Transpose [Transpose] inputs: [/encoder_embed/convnext/Add_output_0 -> (-1, 128, -1, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Transpose for ONNX node: /encoder_embed/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Transpose_output_0 for ONNX tensor: /encoder_embed/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Transpose [Transpose] outputs: [/encoder_embed/Transpose_output_0 -> (-1, -1, 128, 19)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Mul [Mul] inputs: [/encoder_embed/Gather_1_output_0 -> ()[INT32]], [/encoder_embed/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Mul for ONNX node: /encoder_embed/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Mul_output_0 for ONNX tensor: /encoder_embed/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Mul [Mul] outputs: [/encoder_embed/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_96 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_96 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_96 [Constant] outputs: [onnx::Unsqueeze_826 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_826 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_1 [Unsqueeze] inputs: [/encoder_embed/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_826 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Unsqueeze_1 for ONNX node: /encoder_embed/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Unsqueeze_1_output_0 for ONNX tensor: /encoder_embed/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_1 [Unsqueeze] outputs: [/encoder_embed/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_98 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_98 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_98 [Constant] outputs: [onnx::Unsqueeze_828 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_828 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_2 [Unsqueeze] inputs: [/encoder_embed/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_828 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Unsqueeze_2 for ONNX node: /encoder_embed/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Unsqueeze_2_output_0 for ONNX tensor: /encoder_embed/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_2 [Unsqueeze] outputs: [/encoder_embed/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_100 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_100 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_100 [Constant] outputs: [onnx::Unsqueeze_830 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_830 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_3 [Unsqueeze] inputs: [/encoder_embed/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_830 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Unsqueeze_3 for ONNX node: /encoder_embed/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Unsqueeze_3_output_0 for ONNX tensor: /encoder_embed/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Unsqueeze_3 [Unsqueeze] outputs: [/encoder_embed/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Concat [Concat] inputs: [/encoder_embed/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder_embed/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder_embed/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Concat for ONNX node: /encoder_embed/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Concat_output_0 for ONNX tensor: /encoder_embed/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Concat [Concat] outputs: [/encoder_embed/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Reshape [Reshape] inputs: [/encoder_embed/Transpose_output_0 -> (-1, -1, 128, 19)[FLOAT]], [/encoder_embed/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Reshape for ONNX node: /encoder_embed/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Reshape_output_0 for ONNX tensor: /encoder_embed/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Reshape [Reshape] outputs: [/encoder_embed/Reshape_output_0 -> (-1, -1, 2432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9177 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out/MatMul [MatMul] inputs: [/encoder_embed/Reshape_output_0 -> (-1, -1, 2432)[FLOAT]], [onnx::MatMul_9177 -> (2432, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9177 for ONNX node: onnx::MatMul_9177 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out/MatMul for ONNX node: /encoder_embed/out/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out/MatMul_output_0 for ONNX tensor: /encoder_embed/out/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out/MatMul [MatMul] outputs: [/encoder_embed/out/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.out.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out/Add [Add] inputs: [encoder_embed.out.bias -> (192)[FLOAT]], [/encoder_embed/out/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder_embed.out.bias for ONNX node: encoder_embed.out.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out/Add for ONNX node: /encoder_embed/out/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out/Add_output_0 for ONNX tensor: /encoder_embed/out/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out/Add [Add] outputs: [/encoder_embed/out/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.out_norm.bias [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Sub [Sub] inputs: [/encoder_embed/out/Add_output_0 -> (-1, -1, 192)[FLOAT]], [encoder_embed.out_norm.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder_embed.out_norm.bias for ONNX node: encoder_embed.out_norm.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Sub for ONNX node: /encoder_embed/out_norm/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Sub_output_0 for ONNX tensor: /encoder_embed/out_norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Sub [Sub] outputs: [/encoder_embed/out_norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Constant [Constant] outputs: [/encoder_embed/out_norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Pow [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Pow [Pow] inputs: [/encoder_embed/out_norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder_embed/out_norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Constant_output_0 for ONNX node: /encoder_embed/out_norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Pow for ONNX node: /encoder_embed/out_norm/Pow [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Pow_output_0 for ONNX tensor: /encoder_embed/out_norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Pow [Pow] outputs: [/encoder_embed/out_norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/ReduceMean [ReduceMean] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/ReduceMean [ReduceMean] inputs: [/encoder_embed/out_norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/ReduceMean for ONNX node: /encoder_embed/out_norm/ReduceMean [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/ReduceMean_output_0 for ONNX tensor: /encoder_embed/out_norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/ReduceMean [ReduceMean] outputs: [/encoder_embed/out_norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Constant_1 [Constant] outputs: [/encoder_embed/out_norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Pow_1 [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Pow_1 [Pow] inputs: [/encoder_embed/out_norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder_embed/out_norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Constant_1_output_0 for ONNX node: /encoder_embed/out_norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Pow_1 for ONNX node: /encoder_embed/out_norm/Pow_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Pow_1_output_0 for ONNX tensor: /encoder_embed/out_norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Pow_1 [Pow] outputs: [/encoder_embed/out_norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder_embed.out_norm.log_scale [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Exp [Exp] inputs: [encoder_embed.out_norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder_embed.out_norm.log_scale for ONNX node: encoder_embed.out_norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Exp for ONNX node: /encoder_embed/out_norm/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Exp_output_0 for ONNX tensor: /encoder_embed/out_norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Exp [Exp] outputs: [/encoder_embed/out_norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Mul [Mul] inputs: [/encoder_embed/out_norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder_embed/out_norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Mul for ONNX node: /encoder_embed/out_norm/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Mul_output_0 for ONNX tensor: /encoder_embed/out_norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Mul [Mul] outputs: [/encoder_embed/out_norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/out_norm/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Mul_1 [Mul] inputs: [/encoder_embed/out/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder_embed/out_norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/out_norm/Mul_1 for ONNX node: /encoder_embed/out_norm/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/out_norm/Mul_1_output_0 for ONNX tensor: /encoder_embed/out_norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/out_norm/Mul_1 [Mul] outputs: [/encoder_embed/out_norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_5 [Constant] outputs: [/encoder_embed/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: x_lens [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Sub [Sub] inputs: [x_lens -> (-1)[INT32]], [/encoder_embed/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_5_output_0 for ONNX node: /encoder_embed/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Sub for ONNX node: /encoder_embed/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Sub_output_0 for ONNX tensor: /encoder_embed/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Sub [Sub] outputs: [/encoder_embed/Sub_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Constant_6 [Constant] outputs: [/encoder_embed/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Div [Div] inputs: [/encoder_embed/Sub_output_0 -> (-1)[INT32]], [/encoder_embed/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Constant_6_output_0 for ONNX node: /encoder_embed/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Div for ONNX node: /encoder_embed/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Div_output_0 for ONNX tensor: /encoder_embed/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Div [Div] outputs: [/encoder_embed/Div_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Cast [Cast] inputs: [/encoder_embed/Div_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Cast for ONNX node: /encoder_embed/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Cast_output_0 for ONNX tensor: /encoder_embed/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Cast [Cast] outputs: [/encoder_embed/Cast_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder_embed/Cast_1 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Cast_1 [Cast] inputs: [/encoder_embed/Cast_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder_embed/Cast_1 for ONNX node: /encoder_embed/Cast_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder_embed/Cast_1_output_0 for ONNX tensor: /encoder_embed/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder_embed/Cast_1 [Cast] outputs: [/encoder_embed/Cast_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /ReduceMax [ReduceMax] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /ReduceMax [ReduceMax] inputs: [/encoder_embed/Cast_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /ReduceMax for ONNX node: /ReduceMax [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /ReduceMax_output_0 for ONNX tensor: /ReduceMax_output_0 [07/20/2023-07:25:30] [V] [TRT] /ReduceMax [ReduceMax] outputs: [/ReduceMax_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /Shape [Shape] inputs: [/encoder_embed/Cast_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Shape for ONNX node: /Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Shape_output_0 for ONNX tensor: /Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /Shape [Shape] outputs: [/Shape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant [Constant] outputs: [/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /Gather [Gather] inputs: [/Shape_output_0 -> (1)[INT32]], [/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Constant_output_0 for ONNX node: /Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Gather for ONNX node: /Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Gather_output_0 for ONNX tensor: /Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /Gather [Gather] outputs: [/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_1 [Constant] outputs: [/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /ReduceMax_output_0 [07/20/2023-07:25:30] [V] [TRT] /Cast [Cast] inputs: [/ReduceMax_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Cast for ONNX node: /Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Cast_output_0 for ONNX tensor: /Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /Cast [Cast] outputs: [/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_2 [Constant] outputs: [/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Range [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /Range [Range] inputs: [/Constant_1_output_0 -> ()[INT32]], [/Cast_output_0 -> ()[INT32]], [/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Range for ONNX node: /Range [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Range_output_0 for ONNX tensor: /Range_output_0 [07/20/2023-07:25:30] [V] [TRT] /Range [Range] outputs: [/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_3 [Constant] outputs: [/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Range_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze [Unsqueeze] inputs: [/Range_output_0 -> (-1)[INT32]], [/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Unsqueeze for ONNX node: /Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Unsqueeze_output_0 for ONNX tensor: /Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze [Unsqueeze] outputs: [/Unsqueeze_output_0 -> (1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_4 [Constant] outputs: [/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_1 [Unsqueeze] inputs: [/Gather_output_0 -> ()[INT32]], [/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Unsqueeze_1 for ONNX node: /Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Unsqueeze_1_output_0 for ONNX tensor: /Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_1 [Unsqueeze] outputs: [/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_5 [Constant] outputs: [/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /ReduceMax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_2 [Unsqueeze] inputs: [/ReduceMax_output_0 -> ()[INT32]], [/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Unsqueeze_2 for ONNX node: /Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Unsqueeze_2_output_0 for ONNX tensor: /Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_2 [Unsqueeze] outputs: [/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /Concat [Concat] inputs: [/Unsqueeze_1_output_0 -> (1)[INT32]], [/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Concat for ONNX node: /Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Concat_output_0 for ONNX tensor: /Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /Concat [Concat] outputs: [/Concat_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_6 [Constant] outputs: [/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /Reshape [Reshape] inputs: [/Concat_output_0 -> (2)[INT32]], [/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Reshape for ONNX node: /Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Reshape_output_0 for ONNX tensor: /Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /Reshape [Reshape] outputs: [/Reshape_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /Shape_1 [Shape] inputs: [/Reshape_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Shape_1 for ONNX node: /Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Shape_1_output_0 for ONNX tensor: /Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /Shape_1 [Shape] outputs: [/Shape_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /ConstantOfShape [ConstantOfShape] inputs: [/Shape_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /ConstantOfShape_output_0 for ONNX tensor: /ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /ConstantOfShape [ConstantOfShape] outputs: [/ConstantOfShape_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_7 [Constant] outputs: [/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /Mul [Mul] inputs: [/ConstantOfShape_output_0 -> (2)[INT32]], [/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Constant_7_output_0 for ONNX node: /Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Mul for ONNX node: /Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Mul_output_0 for ONNX tensor: /Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /Mul [Mul] outputs: [/Mul_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /Equal [Equal] inputs: [/Reshape_output_0 -> (2)[INT32]], [/Mul_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Equal for ONNX node: /Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Equal_output_0 for ONNX tensor: /Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /Equal [Equal] outputs: [/Equal_output_0 -> (2)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /Where [Where] inputs: [/Equal_output_0 -> (2)[BOOL]], [/ConstantOfShape_output_0 -> (2)[INT32]], [/Reshape_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Where for ONNX node: /Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Where_output_0 for ONNX tensor: /Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /Where [Where] outputs: [/Where_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /Expand [Expand] inputs: [/Unsqueeze_output_0 -> (1, -1)[INT32]], [/Where_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Expand for ONNX node: /Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Expand_output_0 for ONNX tensor: /Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /Expand [Expand] outputs: [/Expand_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /Constant_8 [Constant] outputs: [/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_3 [Unsqueeze] inputs: [/encoder_embed/Cast_1_output_0 -> (-1)[INT32]], [/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Unsqueeze_3 for ONNX node: /Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Unsqueeze_3_output_0 for ONNX tensor: /Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /Unsqueeze_3 [Unsqueeze] outputs: [/Unsqueeze_3_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /GreaterOrEqual [GreaterOrEqual] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /GreaterOrEqual [GreaterOrEqual] inputs: [/Expand_output_0 -> (-1, -1)[INT32]], [/Unsqueeze_3_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /GreaterOrEqual for ONNX node: /GreaterOrEqual [07/20/2023-07:25:30] [V] [TRT] Registering layer: /GreaterOrEqual_31 for ONNX node: /GreaterOrEqual [07/20/2023-07:25:30] [V] [TRT] Registering layer: /GreaterOrEqual_32 for ONNX node: /GreaterOrEqual [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /GreaterOrEqual_output_0 for ONNX tensor: /GreaterOrEqual_output_0 [07/20/2023-07:25:30] [V] [TRT] /GreaterOrEqual [GreaterOrEqual] outputs: [/GreaterOrEqual_output_0 -> (-1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder_embed/out_norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /Transpose [Transpose] inputs: [/encoder_embed/out_norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /Transpose for ONNX node: /Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /Transpose_output_0 for ONNX tensor: /Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /Transpose [Transpose] outputs: [/Transpose_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant [Constant] outputs: [/encoder/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_1 [Constant] outputs: [/encoder/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_2 [Constant] outputs: [/encoder/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_3 [Constant] outputs: [/encoder/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Slice [Slice] inputs: [/Transpose_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/Constant_1_output_0 -> (1)[INT32]], [/encoder/Constant_2_output_0 -> (1)[INT32]], [/encoder/Constant_output_0 -> (1)[INT32]], [/encoder/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Slice for ONNX node: /encoder/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Slice_output_0 for ONNX tensor: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Slice [Slice] outputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant [Constant] outputs: [/encoder/0/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Shape [Shape] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Shape for ONNX node: /encoder/0/encoder_pos/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/0/encoder_pos/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Shape [Shape] outputs: [/encoder/0/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_1 [Constant] outputs: [/encoder/0/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Gather [Gather] inputs: [/encoder/0/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/0/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/0/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Gather for ONNX node: /encoder/0/encoder_pos/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/0/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Gather [Gather] outputs: [/encoder/0/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_2 [Constant] outputs: [/encoder/0/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Sub [Sub] inputs: [/encoder/0/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/0/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/0/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Sub for ONNX node: /encoder/0/encoder_pos/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/0/encoder_pos/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Sub [Sub] outputs: [/encoder/0/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_3 [Constant] outputs: [/encoder/0/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Add [Add] inputs: [/encoder/0/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/0/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/0/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Add for ONNX node: /encoder/0/encoder_pos/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Add_output_0 for ONNX tensor: /encoder/0/encoder_pos/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Add [Add] outputs: [/encoder/0/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_4 [Constant] outputs: [/encoder/0/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Add_1 [Add] inputs: [/encoder/0/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/0/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/0/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Add_1 for ONNX node: /encoder/0/encoder_pos/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/0/encoder_pos/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Add_1 [Add] outputs: [/encoder/0/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_5 [Constant] outputs: [/encoder/0/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/0/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/0/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Unsqueeze for ONNX node: /encoder/0/encoder_pos/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/0/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/0/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_6 [Constant] outputs: [/encoder/0/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/0/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/0/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_7 [Constant] outputs: [/encoder/0/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_8 [Constant] outputs: [/encoder/0/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Slice [Slice] inputs: [/encoder/0/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/0/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/0/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Constant_output_0 for ONNX node: /encoder/0/encoder_pos/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Slice for ONNX node: /encoder/0/encoder_pos/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/0/encoder_pos/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Slice [Slice] outputs: [/encoder/0/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Constant_9 [Constant] outputs: [/encoder/0/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/0/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/0/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9180 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9180 -> (192, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9180 for ONNX node: onnx::MatMul_9180 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/in_proj/Add for ONNX node: /encoder/0/layers.0/self_attn_weights/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice [Slice] inputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Slice for ONNX node: /encoder/0/layers.0/self_attn_weights/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice [Slice] outputs: [/encoder/0/layers.0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Slice_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/0/layers.0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/0/layers.0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Slice_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/0/layers.0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_196 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_196 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_196 [Constant] outputs: [onnx::Unsqueeze_929 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_929 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_929 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_198 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_198 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_198 [Constant] outputs: [onnx::Unsqueeze_931 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_931 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_931 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_203 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_203 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_203 [Constant] outputs: [onnx::Unsqueeze_938 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_938 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_938 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_205 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_205 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_205 [Constant] outputs: [onnx::Unsqueeze_940 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_940 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_940 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_211 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_211 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_211 [Constant] outputs: [onnx::Unsqueeze_948 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_948 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_948 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_213 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_213 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_213 [Constant] outputs: [onnx::Unsqueeze_950 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_950 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_950 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/0/layers.0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Transpose for ONNX node: /encoder/0/layers.0/self_attn_weights/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/0/layers.0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Transpose_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/0/layers.0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Transpose_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Transpose_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/0/layers.0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/0/layers.0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/MatMul for ONNX node: /encoder/0/layers.0/self_attn_weights/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9187 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/0/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9187 -> (48, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9187 for ONNX node: onnx::MatMul_9187 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Mul [Mul] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Mul for ONNX node: /encoder/0/layers.0/self_attn_weights/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Mul [Mul] outputs: [/encoder/0/layers.0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Sub [Sub] inputs: [/encoder/0/layers.0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Sub for ONNX node: /encoder/0/layers.0/self_attn_weights/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Sub [Sub] outputs: [/encoder/0/layers.0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_230 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_230 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_230 [Constant] outputs: [onnx::Unsqueeze_971 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_971 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_971 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/0/layers.0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Transpose_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Transpose_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/0/layers.0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/0/layers.0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/MatMul_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/MatMul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather_3 for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_4 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather_4 for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_5 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Gather_5 for ONNX node: /encoder/0/layers.0/self_attn_weights/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/0/layers.0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Sub_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/0/layers.0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast [Cast] inputs: [/encoder/0/layers.0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Cast for ONNX node: /encoder/0/layers.0/self_attn_weights/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast [Cast] outputs: [/encoder/0/layers.0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Range [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Range [Range] inputs: [/encoder/0/layers.0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Range for ONNX node: /encoder/0/layers.0/self_attn_weights/Range [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Range [Range] outputs: [/encoder/0/layers.0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Cast_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Cast_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/0/layers.0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Range_1 [Range] inputs: [/encoder/0/layers.0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Range_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Range_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Range_1 [Range] outputs: [/encoder/0/layers.0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Mul_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/0/layers.0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_261 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_261 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_261 [Constant] outputs: [onnx::Unsqueeze_1004 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1004 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1004 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_4 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_264 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_264 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_264 [Constant] outputs: [onnx::Unsqueeze_1007 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1007 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1007 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_5 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Shape_6 for ONNX node: /encoder/0/layers.0/self_attn_weights/Shape_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/0/layers.0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/0/layers.0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/0/layers.0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Expand [Expand] inputs: [/encoder/0/layers.0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/0/layers.0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Expand for ONNX node: /encoder/0/layers.0/self_attn_weights/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Expand [Expand] outputs: [/encoder/0/layers.0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Tile [Tile] inputs: [/encoder/0/layers.0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Tile for ONNX node: /encoder/0/layers.0/self_attn_weights/Tile [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Tile [Tile] outputs: [/encoder/0/layers.0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Add [Add] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Add for ONNX node: /encoder/0/layers.0/self_attn_weights/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Add [Add] outputs: [/encoder/0/layers.0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_275 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_275 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_275 [Constant] outputs: [onnx::Unsqueeze_1019 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1019 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_1019 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_6 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape_4 for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/0/layers.0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/GatherElements for ONNX node: /encoder/0/layers.0/self_attn_weights/GatherElements [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/0/layers.0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_280 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_280 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_280 [Constant] outputs: [onnx::Unsqueeze_1024 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1024 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1024 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_282 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_282 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_282 [Constant] outputs: [onnx::Unsqueeze_1026 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1026 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1026 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_284 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_284 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_284 [Constant] outputs: [onnx::Unsqueeze_1028 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1028 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1028 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_286 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_286 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_286 [Constant] outputs: [onnx::Unsqueeze_1030 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1030 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1030 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Concat_7 for ONNX node: /encoder/0/layers.0/self_attn_weights/Concat_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/0/layers.0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/0/layers.0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Reshape_5 for ONNX node: /encoder/0/layers.0/self_attn_weights/Reshape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/0/layers.0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Add_1 [Add] inputs: [/encoder/0/layers.0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Add_1 for ONNX node: /encoder/0/layers.0/self_attn_weights/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Add_1 [Add] outputs: [/encoder/0/layers.0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /GreaterOrEqual_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_15 [Unsqueeze] inputs: [/GreaterOrEqual_output_0 -> (-1, -1)[BOOL]], [/encoder/0/layers.0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15 for ONNX node: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Unsqueeze_15 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Cast_2 for ONNX node: /encoder/0/layers.0/self_attn_weights/Cast_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/0/layers.0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Constant_37 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_37 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Constant_37 [Constant] outputs: [/encoder/0/layers.0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Where [Where] inputs: [/encoder/0/layers.0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [/encoder/0/layers.0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Constant_37_output_0 for ONNX node: /encoder/0/layers.0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Where for ONNX node: /encoder/0/layers.0/self_attn_weights/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Where [Where] outputs: [/encoder/0/layers.0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/0/layers.0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn_weights/Softmax for ONNX node: /encoder/0/layers.0/self_attn_weights/Softmax [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/0/layers.0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9194 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9194 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9194 for ONNX node: onnx::MatMul_9194 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.feed_forward1.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/in_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Sub for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Exp for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Log for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Cast for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Equal for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/0/layers.0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Where for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/0/layers.0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Mul for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9195 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9195 -> (384, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9195 for ONNX node: onnx::MatMul_9195 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.0.feed_forward1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/0/layers.0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add [Add] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add for ONNX node: /encoder/0/layers.0/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_output_0 for ONNX tensor: /encoder/0/layers.0/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add [Add] outputs: [/encoder/0/layers.0/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant [Constant] outputs: [/encoder/0/layers.0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_1 [Constant] outputs: [/encoder/0/layers.0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_2 [Constant] outputs: [/encoder/0/layers.0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Constant_3 [Constant] outputs: [/encoder/0/layers.0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Slice [Slice] inputs: [/encoder/0/layers.0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/Constant_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/Constant_output_0 -> (1)[INT32]], [/encoder/0/layers.0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Slice for ONNX node: /encoder/0/layers.0/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Slice_output_0 for ONNX tensor: /encoder/0/layers.0/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Slice [Slice] outputs: [/encoder/0/layers.0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9196 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9196 -> (192, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9196 for ONNX node: onnx::MatMul_9196 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias -> (432)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/in_proj/Add for ONNX node: /encoder/0/layers.0/nonlin_attention/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape [Shape] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Add [Add] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Add for ONNX node: /encoder/0/layers.0/nonlin_attention/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Add [Add] outputs: [/encoder/0/layers.0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Div [Div] inputs: [/encoder/0/layers.0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Div for ONNX node: /encoder/0/layers.0/nonlin_attention/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Div [Div] outputs: [/encoder/0/layers.0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul [Mul] inputs: [/encoder/0/layers.0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Mul for ONNX node: /encoder/0/layers.0/nonlin_attention/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul [Mul] outputs: [/encoder/0/layers.0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice [Slice] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Slice for ONNX node: /encoder/0/layers.0/nonlin_attention/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice [Slice] outputs: [/encoder/0/layers.0/nonlin_attention/Slice_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/0/layers.0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Mul_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/0/layers.0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Slice_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/0/layers.0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/0/layers.0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Mul_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/0/layers.0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/0/layers.0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Slice_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/0/layers.0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/0/layers.0/nonlin_attention/Slice_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/0/layers.0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/0/layers.0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _, 144), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 144, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_350 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_350 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_350 [Constant] outputs: [onnx::Unsqueeze_1097 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1097 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1097 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_352 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_352 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_352 [Constant] outputs: [onnx::Unsqueeze_1099 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1099 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1099 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat [Concat] inputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Concat for ONNX node: /encoder/0/layers.0/nonlin_attention/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat [Concat] outputs: [/encoder/0/layers.0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 144, 1)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Reshape for ONNX node: /encoder/0/layers.0/nonlin_attention/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/0/layers.0/nonlin_attention/Reshape_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/0/layers.0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Reshape_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Mul_3 for ONNX node: /encoder/0/layers.0/nonlin_attention/Mul_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/0/layers.0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/0/layers.0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape_3 for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather_3 for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/0/layers.0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape_4 for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather_4 for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/0/layers.0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Shape_5 for ONNX node: /encoder/0/layers.0/nonlin_attention/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/0/layers.0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/0/layers.0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Gather_5 for ONNX node: /encoder/0/layers.0/nonlin_attention/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/0/layers.0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_367 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_367 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_367 [Constant] outputs: [onnx::Unsqueeze_1115 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1115 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1115 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_369 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_369 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_369 [Constant] outputs: [onnx::Unsqueeze_1117 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1117 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1117 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_371 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_371 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_371 [Constant] outputs: [onnx::Unsqueeze_1119 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1119 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_1119 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Concat_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/0/layers.0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/0/layers.0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Reshape_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/0/layers.0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/0/layers.0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Transpose for ONNX node: /encoder/0/layers.0/nonlin_attention/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/0/layers.0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/0/layers.0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/MatMul for ONNX node: /encoder/0/layers.0/nonlin_attention/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/0/layers.0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Transpose_1 for ONNX node: /encoder/0/layers.0/nonlin_attention/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_379 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_379 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_379 [Constant] outputs: [onnx::Unsqueeze_1128 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1128 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1128 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_381 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_381 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_381 [Constant] outputs: [onnx::Unsqueeze_1130 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1130 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/0/layers.0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1130 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/0/layers.0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/0/layers.0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/0/layers.0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/0/layers.0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Concat_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/0/layers.0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/0/layers.0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Reshape_2 for ONNX node: /encoder/0/layers.0/nonlin_attention/Reshape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/0/layers.0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/0/layers.0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/Mul_4 for ONNX node: /encoder/0/layers.0/nonlin_attention/Mul_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/0/layers.0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9200 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 144)[FLOAT]], [onnx::MatMul_9200 -> (144, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9200 for ONNX node: onnx::MatMul_9200 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/nonlin_attention/out_proj/Add for ONNX node: /encoder/0/layers.0/nonlin_attention/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/0/layers.0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_1 [Add] inputs: [/encoder/0/layers.0/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_1 for ONNX node: /encoder/0/layers.0/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_1 [Add] outputs: [/encoder/0/layers.0/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape [Shape] inputs: [/encoder/0/layers.0/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Shape for ONNX node: /encoder/0/layers.0/self_attn1/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape [Shape] outputs: [/encoder/0/layers.0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant [Constant] outputs: [/encoder/0/layers.0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather [Gather] inputs: [/encoder/0/layers.0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Constant_output_0 for ONNX node: /encoder/0/layers.0/self_attn1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Gather for ONNX node: /encoder/0/layers.0/self_attn1/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather [Gather] outputs: [/encoder/0/layers.0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_1 [Shape] inputs: [/encoder/0/layers.0/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Shape_1 for ONNX node: /encoder/0/layers.0/self_attn1/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_1 [Shape] outputs: [/encoder/0/layers.0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_1 [Constant] outputs: [/encoder/0/layers.0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_1 [Gather] inputs: [/encoder/0/layers.0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Gather_1 for ONNX node: /encoder/0/layers.0/self_attn1/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_1 [Gather] outputs: [/encoder/0/layers.0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_2 [Shape] inputs: [/encoder/0/layers.0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Shape_2 for ONNX node: /encoder/0/layers.0/self_attn1/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_2 [Shape] outputs: [/encoder/0/layers.0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_2 [Constant] outputs: [/encoder/0/layers.0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_2 [Gather] inputs: [/encoder/0/layers.0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Gather_2 for ONNX node: /encoder/0/layers.0/self_attn1/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_2 [Gather] outputs: [/encoder/0/layers.0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9201 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9201 -> (192, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9201 for ONNX node: onnx::MatMul_9201 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/in_proj/MatMul for ONNX node: /encoder/0/layers.0/self_attn1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/0/layers.0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/in_proj/Add for ONNX node: /encoder/0/layers.0/self_attn1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/in_proj/Add [Add] outputs: [/encoder/0/layers.0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_401 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_401 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_401 [Constant] outputs: [onnx::Unsqueeze_1153 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1153 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1153 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_403 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_403 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_403 [Constant] outputs: [onnx::Unsqueeze_1155 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1155 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1155 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_405 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_405 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_405 [Constant] outputs: [onnx::Unsqueeze_1157 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1157 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1157 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_3 [Constant] outputs: [/encoder/0/layers.0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Concat [Concat] inputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Concat for ONNX node: /encoder/0/layers.0/self_attn1/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Concat [Concat] outputs: [/encoder/0/layers.0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Reshape [Reshape] inputs: [/encoder/0/layers.0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/0/layers.0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Reshape for ONNX node: /encoder/0/layers.0/self_attn1/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Reshape [Reshape] outputs: [/encoder/0/layers.0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Transpose [Transpose] inputs: [/encoder/0/layers.0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Transpose for ONNX node: /encoder/0/layers.0/self_attn1/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Transpose [Transpose] outputs: [/encoder/0/layers.0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_3 [Shape] inputs: [/encoder/0/layers.0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Shape_3 for ONNX node: /encoder/0/layers.0/self_attn1/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Shape_3 [Shape] outputs: [/encoder/0/layers.0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Constant_4 [Constant] outputs: [/encoder/0/layers.0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_3 [Gather] inputs: [/encoder/0/layers.0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Gather_3 for ONNX node: /encoder/0/layers.0/self_attn1/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Gather_3 [Gather] outputs: [/encoder/0/layers.0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/MatMul [MatMul] inputs: [/encoder/0/layers.0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/MatMul for ONNX node: /encoder/0/layers.0/self_attn1/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Transpose_1 for ONNX node: /encoder/0/layers.0/self_attn1/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Mul [Mul] inputs: [/encoder/0/layers.0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Mul for ONNX node: /encoder/0/layers.0/self_attn1/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Mul [Mul] outputs: [/encoder/0/layers.0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_417 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_417 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_417 [Constant] outputs: [onnx::Unsqueeze_1170 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1170 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1170 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_419 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_419 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_419 [Constant] outputs: [onnx::Unsqueeze_1172 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1172 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1172 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_421 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_421 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_421 [Constant] outputs: [onnx::Unsqueeze_1174 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1174 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_1174 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/0/layers.0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Concat_1 [Concat] inputs: [/encoder/0/layers.0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Concat_1 for ONNX node: /encoder/0/layers.0/self_attn1/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Concat_1 [Concat] outputs: [/encoder/0/layers.0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/0/layers.0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/0/layers.0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/Reshape_1 for ONNX node: /encoder/0/layers.0/self_attn1/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/0/layers.0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9203 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9203 -> (48, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9203 for ONNX node: onnx::MatMul_9203 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/out_proj/MatMul for ONNX node: /encoder/0/layers.0/self_attn1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.self_attn1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn1/out_proj/Add for ONNX node: /encoder/0/layers.0/self_attn1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn1/out_proj/Add [Add] outputs: [/encoder/0/layers.0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_2 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_2 [Add] inputs: [/encoder/0/layers.0/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_2 for ONNX node: /encoder/0/layers.0/Add_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_2_output_0 for ONNX tensor: /encoder/0/layers.0/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_2 [Add] outputs: [/encoder/0/layers.0/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9204 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9204 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9204 for ONNX node: onnx::MatMul_9204 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/in_proj/MatMul for ONNX node: /encoder/0/layers.0/conv_module1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.conv_module1.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/in_proj/Add for ONNX node: /encoder/0/layers.0/conv_module1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/in_proj/Add [Add] outputs: [/encoder/0/layers.0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Shape [Shape] inputs: [/encoder/0/layers.0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Shape for ONNX node: /encoder/0/layers.0/conv_module1/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Shape [Shape] outputs: [/encoder/0/layers.0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Gather [Gather] inputs: [/encoder/0/layers.0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Gather for ONNX node: /encoder/0/layers.0/conv_module1/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Gather [Gather] outputs: [/encoder/0/layers.0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_1 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_2 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Add [Add] inputs: [/encoder/0/layers.0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Add for ONNX node: /encoder/0/layers.0/conv_module1/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Add [Add] outputs: [/encoder/0/layers.0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_3 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Div [Div] inputs: [/encoder/0/layers.0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Div for ONNX node: /encoder/0/layers.0/conv_module1/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Div_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Div [Div] outputs: [/encoder/0/layers.0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_4 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul [Mul] inputs: [/encoder/0/layers.0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Mul for ONNX node: /encoder/0/layers.0/conv_module1/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul [Mul] outputs: [/encoder/0/layers.0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Slice [Slice] inputs: [/encoder/0/layers.0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Slice for ONNX node: /encoder/0/layers.0/conv_module1/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Slice [Slice] outputs: [/encoder/0/layers.0/conv_module1/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_5 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul_1 [Mul] inputs: [/encoder/0/layers.0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Mul_1 for ONNX node: /encoder/0/layers.0/conv_module1/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul_1 [Mul] outputs: [/encoder/0/layers.0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Slice_1 [Slice] inputs: [/encoder/0/layers.0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Slice_1 for ONNX node: /encoder/0/layers.0/conv_module1/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Slice_1 [Slice] outputs: [/encoder/0/layers.0/conv_module1/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/0/layers.0/conv_module1/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/0/layers.0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul_2 [Mul] inputs: [/encoder/0/layers.0/conv_module1/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Mul_2 for ONNX node: /encoder/0/layers.0/conv_module1/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Mul_2 [Mul] outputs: [/encoder/0/layers.0/conv_module1/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Transpose [Transpose] inputs: [/encoder/0/layers.0/conv_module1/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Transpose for ONNX node: /encoder/0/layers.0/conv_module1/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Transpose [Transpose] outputs: [/encoder/0/layers.0/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Shape_1 [Shape] inputs: [/encoder/0/layers.0/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Shape_1 for ONNX node: /encoder/0/layers.0/conv_module1/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Shape_1 [Shape] outputs: [/encoder/0/layers.0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Expand [Expand] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Expand for ONNX node: /encoder/0/layers.0/conv_module1/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Expand [Expand] outputs: [/encoder/0/layers.0/conv_module1/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Cast [Cast] inputs: [/encoder/0/layers.0/conv_module1/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Cast for ONNX node: /encoder/0/layers.0/conv_module1/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Cast [Cast] outputs: [/encoder/0/layers.0/conv_module1/Cast_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Constant_6 [Constant] outputs: [/encoder/0/layers.0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Where [Where] inputs: [/encoder/0/layers.0/conv_module1/Cast_output_0 -> (-1, 192, -1)[BOOL]], [/encoder/0/layers.0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/0/layers.0/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Where for ONNX node: /encoder/0/layers.0/conv_module1/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Where_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Where [Where] outputs: [/encoder/0/layers.0/conv_module1/Where_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/0/layers.0/conv_module1/Where_output_0 -> (-1, 192, -1)[FLOAT]], [encoder.encoders.0.layers.0.conv_module1.depthwise_conv.weight -> (192, 1, 31)[FLOAT]], [encoder.encoders.0.layers.0.conv_module1.depthwise_conv.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 192, -1) [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 192 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 192, -1, 1) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/0/layers.0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/Transpose_1 for ONNX node: /encoder/0/layers.0/conv_module1/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/0/layers.0/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Sub for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Exp for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Add [Add] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Add for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Add [Add] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Log [Log] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Log for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Log [Log] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Cast for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Equal for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Where [Where] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [/encoder/0/layers.0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Where for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Where [Where] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/0/layers.0/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Mul for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9205 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9205 -> (192, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9205 for ONNX node: onnx::MatMul_9205 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/MatMul for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.0.conv_module1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/0/layers.0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_3 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_3 [Add] inputs: [/encoder/0/layers.0/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_3 for ONNX node: /encoder/0/layers.0/Add_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_3_output_0 for ONNX tensor: /encoder/0/layers.0/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_3 [Add] outputs: [/encoder/0/layers.0/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9206 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9206 -> (192, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9206 for ONNX node: onnx::MatMul_9206 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.feed_forward2.in_proj.bias -> (512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/in_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Sub for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Exp for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Log for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Cast for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Equal for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/0/layers.0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Where for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/0/layers.0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Mul for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9207 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9207 -> (512, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9207 for ONNX node: onnx::MatMul_9207 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.0.feed_forward2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/0/layers.0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_4 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_4 [Add] inputs: [/encoder/0/layers.0/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_4 for ONNX node: /encoder/0/layers.0/Add_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_4_output_0 for ONNX tensor: /encoder/0/layers.0/Add_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_4 [Add] outputs: [/encoder/0/layers.0/Add_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass_mid/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Sub [Sub] inputs: [/encoder/0/layers.0/Add_4_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass_mid/Sub for ONNX node: /encoder/0/layers.0/bypass_mid/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/bypass_mid/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Sub [Sub] outputs: [/encoder/0/layers.0/bypass_mid/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass_mid/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Mul [Mul] inputs: [/encoder/0/layers.0/bypass_mid/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.0.bypass_mid.bypass_scale -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.0.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass_mid/Mul for ONNX node: /encoder/0/layers.0/bypass_mid/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/bypass_mid/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Mul [Mul] outputs: [/encoder/0/layers.0/bypass_mid/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass_mid/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Add [Add] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/bypass_mid/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass_mid/Add for ONNX node: /encoder/0/layers.0/bypass_mid/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/0/layers.0/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass_mid/Add [Add] outputs: [/encoder/0/layers.0/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape [Shape] inputs: [/encoder/0/layers.0/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Shape for ONNX node: /encoder/0/layers.0/self_attn2/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape [Shape] outputs: [/encoder/0/layers.0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant [Constant] outputs: [/encoder/0/layers.0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather [Gather] inputs: [/encoder/0/layers.0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Constant_output_0 for ONNX node: /encoder/0/layers.0/self_attn2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Gather for ONNX node: /encoder/0/layers.0/self_attn2/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather [Gather] outputs: [/encoder/0/layers.0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape_1 [Shape] inputs: [/encoder/0/layers.0/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Shape_1 for ONNX node: /encoder/0/layers.0/self_attn2/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape_1 [Shape] outputs: [/encoder/0/layers.0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_1 [Constant] outputs: [/encoder/0/layers.0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather_1 [Gather] inputs: [/encoder/0/layers.0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Gather_1 for ONNX node: /encoder/0/layers.0/self_attn2/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather_1 [Gather] outputs: [/encoder/0/layers.0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9208 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9208 -> (192, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9208 for ONNX node: onnx::MatMul_9208 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/in_proj/MatMul for ONNX node: /encoder/0/layers.0/self_attn2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/0/layers.0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/in_proj/Add for ONNX node: /encoder/0/layers.0/self_attn2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/in_proj/Add [Add] outputs: [/encoder/0/layers.0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_503 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_503 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_503 [Constant] outputs: [onnx::Unsqueeze_1262 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1262 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1262 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_505 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_505 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_505 [Constant] outputs: [onnx::Unsqueeze_1264 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1264 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1264 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_507 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_507 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_507 [Constant] outputs: [onnx::Unsqueeze_1266 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1266 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1266 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_2 [Constant] outputs: [/encoder/0/layers.0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Concat [Concat] inputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Concat for ONNX node: /encoder/0/layers.0/self_attn2/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Concat [Concat] outputs: [/encoder/0/layers.0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Reshape [Reshape] inputs: [/encoder/0/layers.0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/0/layers.0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Reshape for ONNX node: /encoder/0/layers.0/self_attn2/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Reshape [Reshape] outputs: [/encoder/0/layers.0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Transpose [Transpose] inputs: [/encoder/0/layers.0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Transpose for ONNX node: /encoder/0/layers.0/self_attn2/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Transpose [Transpose] outputs: [/encoder/0/layers.0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape_2 [Shape] inputs: [/encoder/0/layers.0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Shape_2 for ONNX node: /encoder/0/layers.0/self_attn2/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Shape_2 [Shape] outputs: [/encoder/0/layers.0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Constant_3 [Constant] outputs: [/encoder/0/layers.0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather_2 [Gather] inputs: [/encoder/0/layers.0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Gather_2 for ONNX node: /encoder/0/layers.0/self_attn2/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Gather_2 [Gather] outputs: [/encoder/0/layers.0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/MatMul [MatMul] inputs: [/encoder/0/layers.0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/MatMul for ONNX node: /encoder/0/layers.0/self_attn2/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Transpose_1 for ONNX node: /encoder/0/layers.0/self_attn2/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Mul [Mul] inputs: [/encoder/0/layers.0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/0/layers.0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Mul for ONNX node: /encoder/0/layers.0/self_attn2/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Mul [Mul] outputs: [/encoder/0/layers.0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_519 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_519 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_519 [Constant] outputs: [onnx::Unsqueeze_1279 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1279 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1279 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_521 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_521 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_521 [Constant] outputs: [onnx::Unsqueeze_1281 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1281 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1281 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_523 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_523 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_523 [Constant] outputs: [onnx::Unsqueeze_1283 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1283 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_1283 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/0/layers.0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Concat_1 [Concat] inputs: [/encoder/0/layers.0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Concat_1 for ONNX node: /encoder/0/layers.0/self_attn2/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Concat_1 [Concat] outputs: [/encoder/0/layers.0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/0/layers.0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/0/layers.0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/Reshape_1 for ONNX node: /encoder/0/layers.0/self_attn2/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/0/layers.0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9210 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9210 -> (48, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9210 for ONNX node: onnx::MatMul_9210 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/out_proj/MatMul for ONNX node: /encoder/0/layers.0/self_attn2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.self_attn2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/self_attn2/out_proj/Add for ONNX node: /encoder/0/layers.0/self_attn2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/self_attn2/out_proj/Add [Add] outputs: [/encoder/0/layers.0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_5 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_5 [Add] inputs: [/encoder/0/layers.0/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_5 for ONNX node: /encoder/0/layers.0/Add_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_5_output_0 for ONNX tensor: /encoder/0/layers.0/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_5 [Add] outputs: [/encoder/0/layers.0/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9211 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9211 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9211 for ONNX node: onnx::MatMul_9211 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/in_proj/MatMul for ONNX node: /encoder/0/layers.0/conv_module2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.conv_module2.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/in_proj/Add for ONNX node: /encoder/0/layers.0/conv_module2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/in_proj/Add [Add] outputs: [/encoder/0/layers.0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Shape [Shape] inputs: [/encoder/0/layers.0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Shape for ONNX node: /encoder/0/layers.0/conv_module2/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Shape [Shape] outputs: [/encoder/0/layers.0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Gather [Gather] inputs: [/encoder/0/layers.0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Gather for ONNX node: /encoder/0/layers.0/conv_module2/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Gather [Gather] outputs: [/encoder/0/layers.0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_1 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_2 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Add [Add] inputs: [/encoder/0/layers.0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Add for ONNX node: /encoder/0/layers.0/conv_module2/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Add [Add] outputs: [/encoder/0/layers.0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_3 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Div [Div] inputs: [/encoder/0/layers.0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Div for ONNX node: /encoder/0/layers.0/conv_module2/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Div_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Div [Div] outputs: [/encoder/0/layers.0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_4 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul [Mul] inputs: [/encoder/0/layers.0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Mul for ONNX node: /encoder/0/layers.0/conv_module2/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul [Mul] outputs: [/encoder/0/layers.0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Slice [Slice] inputs: [/encoder/0/layers.0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Slice for ONNX node: /encoder/0/layers.0/conv_module2/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Slice [Slice] outputs: [/encoder/0/layers.0/conv_module2/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_5 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul_1 [Mul] inputs: [/encoder/0/layers.0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Mul_1 for ONNX node: /encoder/0/layers.0/conv_module2/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul_1 [Mul] outputs: [/encoder/0/layers.0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Slice_1 [Slice] inputs: [/encoder/0/layers.0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Slice_1 for ONNX node: /encoder/0/layers.0/conv_module2/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Slice_1 [Slice] outputs: [/encoder/0/layers.0/conv_module2/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/0/layers.0/conv_module2/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/0/layers.0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul_2 [Mul] inputs: [/encoder/0/layers.0/conv_module2/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Mul_2 for ONNX node: /encoder/0/layers.0/conv_module2/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Mul_2 [Mul] outputs: [/encoder/0/layers.0/conv_module2/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Transpose [Transpose] inputs: [/encoder/0/layers.0/conv_module2/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Transpose for ONNX node: /encoder/0/layers.0/conv_module2/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Transpose [Transpose] outputs: [/encoder/0/layers.0/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Shape_1 [Shape] inputs: [/encoder/0/layers.0/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Shape_1 for ONNX node: /encoder/0/layers.0/conv_module2/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Shape_1 [Shape] outputs: [/encoder/0/layers.0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Expand [Expand] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Expand for ONNX node: /encoder/0/layers.0/conv_module2/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Expand [Expand] outputs: [/encoder/0/layers.0/conv_module2/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Cast [Cast] inputs: [/encoder/0/layers.0/conv_module2/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Cast for ONNX node: /encoder/0/layers.0/conv_module2/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Cast [Cast] outputs: [/encoder/0/layers.0/conv_module2/Cast_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Constant_6 [Constant] outputs: [/encoder/0/layers.0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Where [Where] inputs: [/encoder/0/layers.0/conv_module2/Cast_output_0 -> (-1, 192, -1)[BOOL]], [/encoder/0/layers.0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/0/layers.0/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Where for ONNX node: /encoder/0/layers.0/conv_module2/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Where_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Where [Where] outputs: [/encoder/0/layers.0/conv_module2/Where_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/0/layers.0/conv_module2/Where_output_0 -> (-1, 192, -1)[FLOAT]], [encoder.encoders.0.layers.0.conv_module2.depthwise_conv.weight -> (192, 1, 31)[FLOAT]], [encoder.encoders.0.layers.0.conv_module2.depthwise_conv.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 192, -1) [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 192 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 192, -1, 1) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/0/layers.0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/0/layers.0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/Transpose_1 for ONNX node: /encoder/0/layers.0/conv_module2/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/0/layers.0/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/0/layers.0/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Sub for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Exp for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Add [Add] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Add for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Add [Add] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Log [Log] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Log for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Log [Log] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Cast for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Equal for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Where [Where] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [/encoder/0/layers.0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Where for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Where [Where] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/0/layers.0/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Mul for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9212 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9212 -> (192, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9212 for ONNX node: onnx::MatMul_9212 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/MatMul for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.0.conv_module2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/0/layers.0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_6 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_6 [Add] inputs: [/encoder/0/layers.0/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_6 for ONNX node: /encoder/0/layers.0/Add_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_6_output_0 for ONNX tensor: /encoder/0/layers.0/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_6 [Add] outputs: [/encoder/0/layers.0/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9213 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9213 -> (192, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9213 for ONNX node: onnx::MatMul_9213 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.0.feed_forward3.in_proj.bias -> (640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/in_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward3/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Sub for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Exp for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Add for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Log for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Cast for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Equal for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 640)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 640)[BOOL]], [/encoder/0/layers.0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Where for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/0/layers.0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Mul for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9214 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 640)[FLOAT]], [onnx::MatMul_9214 -> (640, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9214 for ONNX node: onnx::MatMul_9214 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.0.feed_forward3.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.0.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/0/layers.0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/Add_7 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_7 [Add] inputs: [/encoder/0/layers.0/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/Add_7 for ONNX node: /encoder/0/layers.0/Add_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/Add_7_output_0 for ONNX tensor: /encoder/0/layers.0/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/Add_7 [Add] outputs: [/encoder/0/layers.0/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Sub [Sub] inputs: [/encoder/0/layers.0/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.0.norm.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.norm.bias for ONNX node: encoder.encoders.0.layers.0.norm.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Sub for ONNX node: /encoder/0/layers.0/norm/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Sub [Sub] outputs: [/encoder/0/layers.0/norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Constant [Constant] outputs: [/encoder/0/layers.0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Pow [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Pow [Pow] inputs: [/encoder/0/layers.0/norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Constant_output_0 for ONNX node: /encoder/0/layers.0/norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Pow for ONNX node: /encoder/0/layers.0/norm/Pow [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Pow_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Pow [Pow] outputs: [/encoder/0/layers.0/norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/ReduceMean [ReduceMean] inputs: [/encoder/0/layers.0/norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/ReduceMean for ONNX node: /encoder/0/layers.0/norm/ReduceMean [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/0/layers.0/norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/ReduceMean [ReduceMean] outputs: [/encoder/0/layers.0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Constant_1 [Constant] outputs: [/encoder/0/layers.0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Pow_1 [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Pow_1 [Pow] inputs: [/encoder/0/layers.0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/0/layers.0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Constant_1_output_0 for ONNX node: /encoder/0/layers.0/norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Pow_1 for ONNX node: /encoder/0/layers.0/norm/Pow_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Pow_1_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Pow_1 [Pow] outputs: [/encoder/0/layers.0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Exp [Exp] inputs: [encoder.encoders.0.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.norm.log_scale for ONNX node: encoder.encoders.0.layers.0.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Exp for ONNX node: /encoder/0/layers.0/norm/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Exp_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Exp [Exp] outputs: [/encoder/0/layers.0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Mul [Mul] inputs: [/encoder/0/layers.0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/0/layers.0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Mul for ONNX node: /encoder/0/layers.0/norm/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Mul [Mul] outputs: [/encoder/0/layers.0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/norm/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Mul_1 [Mul] inputs: [/encoder/0/layers.0/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/norm/Mul_1 for ONNX node: /encoder/0/layers.0/norm/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/norm/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.0/norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/norm/Mul_1 [Mul] outputs: [/encoder/0/layers.0/norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Sub [Sub] inputs: [/encoder/0/layers.0/norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass/Sub for ONNX node: /encoder/0/layers.0/bypass/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass/Sub_output_0 for ONNX tensor: /encoder/0/layers.0/bypass/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Sub [Sub] outputs: [/encoder/0/layers.0/bypass/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Mul [Mul] inputs: [/encoder/0/layers.0/bypass/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.0.bypass.bypass_scale -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.0.layers.0.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass/Mul for ONNX node: /encoder/0/layers.0/bypass/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass/Mul_output_0 for ONNX tensor: /encoder/0/layers.0/bypass/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Mul [Mul] outputs: [/encoder/0/layers.0/bypass/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.0/bypass/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Add [Add] inputs: [/encoder/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/bypass/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.0/bypass/Add for ONNX node: /encoder/0/layers.0/bypass/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.0/bypass/Add_output_0 for ONNX tensor: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.0/bypass/Add [Add] outputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9215 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9215 -> (192, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9215 for ONNX node: onnx::MatMul_9215 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/in_proj/Add for ONNX node: /encoder/0/layers.1/self_attn_weights/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice [Slice] inputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Slice for ONNX node: /encoder/0/layers.1/self_attn_weights/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice [Slice] outputs: [/encoder/0/layers.1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Slice_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/0/layers.1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/0/layers.1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Slice_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/0/layers.1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_629 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_629 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_629 [Constant] outputs: [onnx::Unsqueeze_1395 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1395 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1395 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_631 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_631 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_631 [Constant] outputs: [onnx::Unsqueeze_1397 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1397 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1397 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_636 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_636 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_636 [Constant] outputs: [onnx::Unsqueeze_1404 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1404 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1404 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_638 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_638 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_638 [Constant] outputs: [onnx::Unsqueeze_1406 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1406 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1406 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_644 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_644 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_644 [Constant] outputs: [onnx::Unsqueeze_1414 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1414 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1414 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_646 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_646 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_646 [Constant] outputs: [onnx::Unsqueeze_1416 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1416 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1416 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/0/layers.1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Transpose for ONNX node: /encoder/0/layers.1/self_attn_weights/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/0/layers.1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Transpose_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/0/layers.1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Transpose_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Transpose_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/0/layers.1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/0/layers.1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/MatMul for ONNX node: /encoder/0/layers.1/self_attn_weights/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9222 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/0/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9222 -> (48, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9222 for ONNX node: onnx::MatMul_9222 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Mul [Mul] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Mul for ONNX node: /encoder/0/layers.1/self_attn_weights/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Mul [Mul] outputs: [/encoder/0/layers.1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Sub [Sub] inputs: [/encoder/0/layers.1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Sub for ONNX node: /encoder/0/layers.1/self_attn_weights/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Sub [Sub] outputs: [/encoder/0/layers.1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_663 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_663 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_663 [Constant] outputs: [onnx::Unsqueeze_1437 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1437 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_1437 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/0/layers.1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Transpose_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Transpose_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/0/layers.1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/0/layers.1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/MatMul_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/MatMul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather_3 for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_4 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather_4 for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_5 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Gather_5 for ONNX node: /encoder/0/layers.1/self_attn_weights/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/0/layers.1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Sub_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/0/layers.1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast [Cast] inputs: [/encoder/0/layers.1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Cast for ONNX node: /encoder/0/layers.1/self_attn_weights/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast [Cast] outputs: [/encoder/0/layers.1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Range [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Range [Range] inputs: [/encoder/0/layers.1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Range for ONNX node: /encoder/0/layers.1/self_attn_weights/Range [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Range [Range] outputs: [/encoder/0/layers.1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Cast_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Cast_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/0/layers.1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Range_1 [Range] inputs: [/encoder/0/layers.1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Range_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Range_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Range_1 [Range] outputs: [/encoder/0/layers.1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Mul_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/0/layers.1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_694 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_694 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_694 [Constant] outputs: [onnx::Unsqueeze_1470 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1470 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1470 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_4 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_697 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_697 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_697 [Constant] outputs: [onnx::Unsqueeze_1473 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1473 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1473 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_5 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Shape_6 for ONNX node: /encoder/0/layers.1/self_attn_weights/Shape_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/0/layers.1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/0/layers.1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/0/layers.1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Expand [Expand] inputs: [/encoder/0/layers.1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/0/layers.1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Expand for ONNX node: /encoder/0/layers.1/self_attn_weights/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Expand [Expand] outputs: [/encoder/0/layers.1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Tile [Tile] inputs: [/encoder/0/layers.1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Tile for ONNX node: /encoder/0/layers.1/self_attn_weights/Tile [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Tile [Tile] outputs: [/encoder/0/layers.1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Add [Add] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Add for ONNX node: /encoder/0/layers.1/self_attn_weights/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Add [Add] outputs: [/encoder/0/layers.1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_708 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_708 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_708 [Constant] outputs: [onnx::Unsqueeze_1485 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1485 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_1485 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_6 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape_4 for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/0/layers.1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/GatherElements for ONNX node: /encoder/0/layers.1/self_attn_weights/GatherElements [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/0/layers.1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_713 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_713 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_713 [Constant] outputs: [onnx::Unsqueeze_1490 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1490 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1490 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_715 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_715 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_715 [Constant] outputs: [onnx::Unsqueeze_1492 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1492 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1492 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_717 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_717 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_717 [Constant] outputs: [onnx::Unsqueeze_1494 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1494 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1494 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_719 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_719 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_719 [Constant] outputs: [onnx::Unsqueeze_1496 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1496 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1496 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/0/layers.1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Concat_7 for ONNX node: /encoder/0/layers.1/self_attn_weights/Concat_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/0/layers.1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/0/layers.1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Reshape_5 for ONNX node: /encoder/0/layers.1/self_attn_weights/Reshape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/0/layers.1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Add_1 [Add] inputs: [/encoder/0/layers.1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Add_1 for ONNX node: /encoder/0/layers.1/self_attn_weights/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Add_1 [Add] outputs: [/encoder/0/layers.1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Cast_2 for ONNX node: /encoder/0/layers.1/self_attn_weights/Cast_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/0/layers.1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/0/layers.1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Where [Where] inputs: [/encoder/0/layers.1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/0/layers.1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/0/layers.1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Where for ONNX node: /encoder/0/layers.1/self_attn_weights/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Where [Where] outputs: [/encoder/0/layers.1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/0/layers.1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn_weights/Softmax for ONNX node: /encoder/0/layers.1/self_attn_weights/Softmax [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/0/layers.1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9229 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9229 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9229 for ONNX node: onnx::MatMul_9229 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.feed_forward1.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/in_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Sub for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Exp for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Log for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Cast for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Equal for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/0/layers.1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Where for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/0/layers.1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Mul for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9230 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9230 -> (384, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9230 for ONNX node: onnx::MatMul_9230 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.1.feed_forward1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/0/layers.1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add [Add] inputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add for ONNX node: /encoder/0/layers.1/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_output_0 for ONNX tensor: /encoder/0/layers.1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add [Add] outputs: [/encoder/0/layers.1/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant [Constant] outputs: [/encoder/0/layers.1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_1 [Constant] outputs: [/encoder/0/layers.1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_2 [Constant] outputs: [/encoder/0/layers.1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Constant_3 [Constant] outputs: [/encoder/0/layers.1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Slice [Slice] inputs: [/encoder/0/layers.1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/Constant_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/Constant_output_0 -> (1)[INT32]], [/encoder/0/layers.1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Slice for ONNX node: /encoder/0/layers.1/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Slice_output_0 for ONNX tensor: /encoder/0/layers.1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Slice [Slice] outputs: [/encoder/0/layers.1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9231 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9231 -> (192, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9231 for ONNX node: onnx::MatMul_9231 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias -> (432)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/in_proj/Add for ONNX node: /encoder/0/layers.1/nonlin_attention/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape [Shape] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Add [Add] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Add for ONNX node: /encoder/0/layers.1/nonlin_attention/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Add [Add] outputs: [/encoder/0/layers.1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Div [Div] inputs: [/encoder/0/layers.1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Div for ONNX node: /encoder/0/layers.1/nonlin_attention/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Div [Div] outputs: [/encoder/0/layers.1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul [Mul] inputs: [/encoder/0/layers.1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Mul for ONNX node: /encoder/0/layers.1/nonlin_attention/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul [Mul] outputs: [/encoder/0/layers.1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice [Slice] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Slice for ONNX node: /encoder/0/layers.1/nonlin_attention/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice [Slice] outputs: [/encoder/0/layers.1/nonlin_attention/Slice_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/0/layers.1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Mul_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/0/layers.1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Slice_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/0/layers.1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/0/layers.1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Mul_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/0/layers.1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/0/layers.1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 432)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Slice_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/0/layers.1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/0/layers.1/nonlin_attention/Slice_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/0/layers.1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/0/layers.1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _, 144), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 144, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_781 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_781 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_781 [Constant] outputs: [onnx::Unsqueeze_1561 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1561 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1561 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_783 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_783 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_783 [Constant] outputs: [onnx::Unsqueeze_1563 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1563 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1563 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat [Concat] inputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Concat for ONNX node: /encoder/0/layers.1/nonlin_attention/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat [Concat] outputs: [/encoder/0/layers.1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 144, 1)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Reshape for ONNX node: /encoder/0/layers.1/nonlin_attention/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/0/layers.1/nonlin_attention/Reshape_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/0/layers.1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Reshape_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Mul_3 for ONNX node: /encoder/0/layers.1/nonlin_attention/Mul_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/0/layers.1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/0/layers.1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape_3 for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather_3 for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/0/layers.1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape_4 for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather_4 for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/0/layers.1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Shape_5 for ONNX node: /encoder/0/layers.1/nonlin_attention/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/0/layers.1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/0/layers.1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Gather_5 for ONNX node: /encoder/0/layers.1/nonlin_attention/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/0/layers.1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_798 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_798 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_798 [Constant] outputs: [onnx::Unsqueeze_1579 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1579 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1579 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_800 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_800 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_800 [Constant] outputs: [onnx::Unsqueeze_1581 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1581 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1581 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_802 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_802 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_802 [Constant] outputs: [onnx::Unsqueeze_1583 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1583 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_1583 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Concat_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/0/layers.1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/0/layers.1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 144)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Reshape_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/0/layers.1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/0/layers.1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Transpose for ONNX node: /encoder/0/layers.1/nonlin_attention/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/0/layers.1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/0/layers.1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/MatMul for ONNX node: /encoder/0/layers.1/nonlin_attention/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/0/layers.1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Transpose_1 for ONNX node: /encoder/0/layers.1/nonlin_attention/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_810 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_810 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_810 [Constant] outputs: [onnx::Unsqueeze_1592 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1592 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_1592 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_812 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_812 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_812 [Constant] outputs: [onnx::Unsqueeze_1594 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1594 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/0/layers.1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_1594 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/0/layers.1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/0/layers.1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/0/layers.1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/0/layers.1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Concat_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/0/layers.1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/0/layers.1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 144)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Reshape_2 for ONNX node: /encoder/0/layers.1/nonlin_attention/Reshape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/0/layers.1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/0/layers.1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/Mul_4 for ONNX node: /encoder/0/layers.1/nonlin_attention/Mul_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/0/layers.1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 144)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9235 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 144)[FLOAT]], [onnx::MatMul_9235 -> (144, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9235 for ONNX node: onnx::MatMul_9235 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/nonlin_attention/out_proj/Add for ONNX node: /encoder/0/layers.1/nonlin_attention/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/0/layers.1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_1 [Add] inputs: [/encoder/0/layers.1/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_1 for ONNX node: /encoder/0/layers.1/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_1 [Add] outputs: [/encoder/0/layers.1/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape [Shape] inputs: [/encoder/0/layers.1/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Shape for ONNX node: /encoder/0/layers.1/self_attn1/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape [Shape] outputs: [/encoder/0/layers.1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant [Constant] outputs: [/encoder/0/layers.1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather [Gather] inputs: [/encoder/0/layers.1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Constant_output_0 for ONNX node: /encoder/0/layers.1/self_attn1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Gather for ONNX node: /encoder/0/layers.1/self_attn1/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather [Gather] outputs: [/encoder/0/layers.1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_1 [Shape] inputs: [/encoder/0/layers.1/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Shape_1 for ONNX node: /encoder/0/layers.1/self_attn1/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_1 [Shape] outputs: [/encoder/0/layers.1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_1 [Constant] outputs: [/encoder/0/layers.1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_1 [Gather] inputs: [/encoder/0/layers.1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Gather_1 for ONNX node: /encoder/0/layers.1/self_attn1/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_1 [Gather] outputs: [/encoder/0/layers.1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_2 [Shape] inputs: [/encoder/0/layers.1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Shape_2 for ONNX node: /encoder/0/layers.1/self_attn1/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_2 [Shape] outputs: [/encoder/0/layers.1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_2 [Constant] outputs: [/encoder/0/layers.1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_2 [Gather] inputs: [/encoder/0/layers.1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Gather_2 for ONNX node: /encoder/0/layers.1/self_attn1/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_2 [Gather] outputs: [/encoder/0/layers.1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9236 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9236 -> (192, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9236 for ONNX node: onnx::MatMul_9236 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/in_proj/MatMul for ONNX node: /encoder/0/layers.1/self_attn1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/0/layers.1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/in_proj/Add for ONNX node: /encoder/0/layers.1/self_attn1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/in_proj/Add [Add] outputs: [/encoder/0/layers.1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_832 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_832 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_832 [Constant] outputs: [onnx::Unsqueeze_1617 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1617 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1617 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_834 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_834 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_834 [Constant] outputs: [onnx::Unsqueeze_1619 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1619 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1619 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_836 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_836 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_836 [Constant] outputs: [onnx::Unsqueeze_1621 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1621 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1621 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_3 [Constant] outputs: [/encoder/0/layers.1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Concat [Concat] inputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Concat for ONNX node: /encoder/0/layers.1/self_attn1/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Concat [Concat] outputs: [/encoder/0/layers.1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Reshape [Reshape] inputs: [/encoder/0/layers.1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/0/layers.1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Reshape for ONNX node: /encoder/0/layers.1/self_attn1/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Reshape [Reshape] outputs: [/encoder/0/layers.1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Transpose [Transpose] inputs: [/encoder/0/layers.1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Transpose for ONNX node: /encoder/0/layers.1/self_attn1/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Transpose [Transpose] outputs: [/encoder/0/layers.1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_3 [Shape] inputs: [/encoder/0/layers.1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Shape_3 for ONNX node: /encoder/0/layers.1/self_attn1/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Shape_3 [Shape] outputs: [/encoder/0/layers.1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Constant_4 [Constant] outputs: [/encoder/0/layers.1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_3 [Gather] inputs: [/encoder/0/layers.1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Gather_3 for ONNX node: /encoder/0/layers.1/self_attn1/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Gather_3 [Gather] outputs: [/encoder/0/layers.1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/MatMul [MatMul] inputs: [/encoder/0/layers.1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/MatMul for ONNX node: /encoder/0/layers.1/self_attn1/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Transpose_1 for ONNX node: /encoder/0/layers.1/self_attn1/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Mul [Mul] inputs: [/encoder/0/layers.1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Mul for ONNX node: /encoder/0/layers.1/self_attn1/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Mul [Mul] outputs: [/encoder/0/layers.1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_848 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_848 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_848 [Constant] outputs: [onnx::Unsqueeze_1634 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1634 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1634 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_850 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_850 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_850 [Constant] outputs: [onnx::Unsqueeze_1636 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1636 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1636 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_852 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_852 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_852 [Constant] outputs: [onnx::Unsqueeze_1638 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1638 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_1638 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/0/layers.1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Concat_1 [Concat] inputs: [/encoder/0/layers.1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Concat_1 for ONNX node: /encoder/0/layers.1/self_attn1/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Concat_1 [Concat] outputs: [/encoder/0/layers.1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/0/layers.1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/0/layers.1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/Reshape_1 for ONNX node: /encoder/0/layers.1/self_attn1/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/0/layers.1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9238 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9238 -> (48, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9238 for ONNX node: onnx::MatMul_9238 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/out_proj/MatMul for ONNX node: /encoder/0/layers.1/self_attn1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.self_attn1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn1/out_proj/Add for ONNX node: /encoder/0/layers.1/self_attn1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn1/out_proj/Add [Add] outputs: [/encoder/0/layers.1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_2 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_2 [Add] inputs: [/encoder/0/layers.1/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_2 for ONNX node: /encoder/0/layers.1/Add_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_2_output_0 for ONNX tensor: /encoder/0/layers.1/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_2 [Add] outputs: [/encoder/0/layers.1/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9239 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9239 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9239 for ONNX node: onnx::MatMul_9239 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/in_proj/MatMul for ONNX node: /encoder/0/layers.1/conv_module1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.conv_module1.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/in_proj/Add for ONNX node: /encoder/0/layers.1/conv_module1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/in_proj/Add [Add] outputs: [/encoder/0/layers.1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Shape [Shape] inputs: [/encoder/0/layers.1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Shape for ONNX node: /encoder/0/layers.1/conv_module1/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Shape [Shape] outputs: [/encoder/0/layers.1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Gather [Gather] inputs: [/encoder/0/layers.1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Gather for ONNX node: /encoder/0/layers.1/conv_module1/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Gather [Gather] outputs: [/encoder/0/layers.1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_1 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_2 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Add [Add] inputs: [/encoder/0/layers.1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Add for ONNX node: /encoder/0/layers.1/conv_module1/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Add [Add] outputs: [/encoder/0/layers.1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_3 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Div [Div] inputs: [/encoder/0/layers.1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Div for ONNX node: /encoder/0/layers.1/conv_module1/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Div_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Div [Div] outputs: [/encoder/0/layers.1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_4 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul [Mul] inputs: [/encoder/0/layers.1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Mul for ONNX node: /encoder/0/layers.1/conv_module1/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul [Mul] outputs: [/encoder/0/layers.1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Slice [Slice] inputs: [/encoder/0/layers.1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Slice for ONNX node: /encoder/0/layers.1/conv_module1/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Slice [Slice] outputs: [/encoder/0/layers.1/conv_module1/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_5 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul_1 [Mul] inputs: [/encoder/0/layers.1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Mul_1 for ONNX node: /encoder/0/layers.1/conv_module1/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul_1 [Mul] outputs: [/encoder/0/layers.1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Slice_1 [Slice] inputs: [/encoder/0/layers.1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Slice_1 for ONNX node: /encoder/0/layers.1/conv_module1/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Slice_1 [Slice] outputs: [/encoder/0/layers.1/conv_module1/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/0/layers.1/conv_module1/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/0/layers.1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul_2 [Mul] inputs: [/encoder/0/layers.1/conv_module1/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Mul_2 for ONNX node: /encoder/0/layers.1/conv_module1/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Mul_2 [Mul] outputs: [/encoder/0/layers.1/conv_module1/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Transpose [Transpose] inputs: [/encoder/0/layers.1/conv_module1/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Transpose for ONNX node: /encoder/0/layers.1/conv_module1/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Transpose [Transpose] outputs: [/encoder/0/layers.1/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Shape_1 [Shape] inputs: [/encoder/0/layers.1/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Shape_1 for ONNX node: /encoder/0/layers.1/conv_module1/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Shape_1 [Shape] outputs: [/encoder/0/layers.1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Expand [Expand] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Expand for ONNX node: /encoder/0/layers.1/conv_module1/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Expand [Expand] outputs: [/encoder/0/layers.1/conv_module1/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Cast [Cast] inputs: [/encoder/0/layers.1/conv_module1/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Cast for ONNX node: /encoder/0/layers.1/conv_module1/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Cast [Cast] outputs: [/encoder/0/layers.1/conv_module1/Cast_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Constant_6 [Constant] outputs: [/encoder/0/layers.1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Where [Where] inputs: [/encoder/0/layers.1/conv_module1/Cast_output_0 -> (-1, 192, -1)[BOOL]], [/encoder/0/layers.1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/0/layers.1/conv_module1/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Where for ONNX node: /encoder/0/layers.1/conv_module1/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Where_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Where [Where] outputs: [/encoder/0/layers.1/conv_module1/Where_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/0/layers.1/conv_module1/Where_output_0 -> (-1, 192, -1)[FLOAT]], [encoder.encoders.0.layers.1.conv_module1.depthwise_conv.weight -> (192, 1, 31)[FLOAT]], [encoder.encoders.0.layers.1.conv_module1.depthwise_conv.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 192, -1) [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 192 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 192, -1, 1) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/0/layers.1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/Transpose_1 for ONNX node: /encoder/0/layers.1/conv_module1/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/0/layers.1/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Sub for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Exp for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Add [Add] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Add for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Add [Add] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Log [Log] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Log for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Log [Log] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Cast for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Equal for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Where [Where] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [/encoder/0/layers.1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Where for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Where [Where] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/0/layers.1/conv_module1/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Mul for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9240 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9240 -> (192, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9240 for ONNX node: onnx::MatMul_9240 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/MatMul for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.1.conv_module1.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/0/layers.1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_3 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_3 [Add] inputs: [/encoder/0/layers.1/Add_2_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_3 for ONNX node: /encoder/0/layers.1/Add_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_3_output_0 for ONNX tensor: /encoder/0/layers.1/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_3 [Add] outputs: [/encoder/0/layers.1/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9241 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9241 -> (192, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9241 for ONNX node: onnx::MatMul_9241 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.feed_forward2.in_proj.bias -> (512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/in_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Sub for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Exp for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Log for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Cast for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Equal for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/0/layers.1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Where for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/0/layers.1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Mul for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9242 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9242 -> (512, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9242 for ONNX node: onnx::MatMul_9242 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.1.feed_forward2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/0/layers.1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_4 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_4 [Add] inputs: [/encoder/0/layers.1/Add_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_4 for ONNX node: /encoder/0/layers.1/Add_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_4_output_0 for ONNX tensor: /encoder/0/layers.1/Add_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_4 [Add] outputs: [/encoder/0/layers.1/Add_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass_mid/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Sub [Sub] inputs: [/encoder/0/layers.1/Add_4_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass_mid/Sub for ONNX node: /encoder/0/layers.1/bypass_mid/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/bypass_mid/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Sub [Sub] outputs: [/encoder/0/layers.1/bypass_mid/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass_mid/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Mul [Mul] inputs: [/encoder/0/layers.1/bypass_mid/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.1.bypass_mid.bypass_scale -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.0.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass_mid/Mul for ONNX node: /encoder/0/layers.1/bypass_mid/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/bypass_mid/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Mul [Mul] outputs: [/encoder/0/layers.1/bypass_mid/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass_mid/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Add [Add] inputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/bypass_mid/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass_mid/Add for ONNX node: /encoder/0/layers.1/bypass_mid/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/0/layers.1/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass_mid/Add [Add] outputs: [/encoder/0/layers.1/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape [Shape] inputs: [/encoder/0/layers.1/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Shape for ONNX node: /encoder/0/layers.1/self_attn2/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape [Shape] outputs: [/encoder/0/layers.1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant [Constant] outputs: [/encoder/0/layers.1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather [Gather] inputs: [/encoder/0/layers.1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Constant_output_0 for ONNX node: /encoder/0/layers.1/self_attn2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Gather for ONNX node: /encoder/0/layers.1/self_attn2/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather [Gather] outputs: [/encoder/0/layers.1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape_1 [Shape] inputs: [/encoder/0/layers.1/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Shape_1 for ONNX node: /encoder/0/layers.1/self_attn2/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape_1 [Shape] outputs: [/encoder/0/layers.1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_1 [Constant] outputs: [/encoder/0/layers.1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather_1 [Gather] inputs: [/encoder/0/layers.1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/0/layers.1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Gather_1 for ONNX node: /encoder/0/layers.1/self_attn2/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather_1 [Gather] outputs: [/encoder/0/layers.1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9243 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9243 -> (192, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9243 for ONNX node: onnx::MatMul_9243 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/in_proj/MatMul for ONNX node: /encoder/0/layers.1/self_attn2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/0/layers.1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/in_proj/Add for ONNX node: /encoder/0/layers.1/self_attn2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/in_proj/Add [Add] outputs: [/encoder/0/layers.1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_934 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_934 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_934 [Constant] outputs: [onnx::Unsqueeze_1726 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1726 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1726 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_936 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_936 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_936 [Constant] outputs: [onnx::Unsqueeze_1728 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1728 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1728 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_938 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_938 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_938 [Constant] outputs: [onnx::Unsqueeze_1730 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1730 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1730 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_2 [Constant] outputs: [/encoder/0/layers.1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Concat [Concat] inputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Concat for ONNX node: /encoder/0/layers.1/self_attn2/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Concat [Concat] outputs: [/encoder/0/layers.1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Reshape [Reshape] inputs: [/encoder/0/layers.1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/0/layers.1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Reshape for ONNX node: /encoder/0/layers.1/self_attn2/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Reshape [Reshape] outputs: [/encoder/0/layers.1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Transpose [Transpose] inputs: [/encoder/0/layers.1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Transpose for ONNX node: /encoder/0/layers.1/self_attn2/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Transpose [Transpose] outputs: [/encoder/0/layers.1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape_2 [Shape] inputs: [/encoder/0/layers.1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Shape_2 for ONNX node: /encoder/0/layers.1/self_attn2/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Shape_2 [Shape] outputs: [/encoder/0/layers.1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Constant_3 [Constant] outputs: [/encoder/0/layers.1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather_2 [Gather] inputs: [/encoder/0/layers.1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/0/layers.1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Gather_2 for ONNX node: /encoder/0/layers.1/self_attn2/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Gather_2 [Gather] outputs: [/encoder/0/layers.1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/MatMul [MatMul] inputs: [/encoder/0/layers.1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/0/layers.1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/MatMul for ONNX node: /encoder/0/layers.1/self_attn2/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Transpose_1 for ONNX node: /encoder/0/layers.1/self_attn2/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Mul [Mul] inputs: [/encoder/0/layers.1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/0/layers.1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Mul for ONNX node: /encoder/0/layers.1/self_attn2/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Mul [Mul] outputs: [/encoder/0/layers.1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_950 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_950 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_950 [Constant] outputs: [onnx::Unsqueeze_1743 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1743 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1743 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_952 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_952 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_952 [Constant] outputs: [onnx::Unsqueeze_1745 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1745 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1745 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_954 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_954 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_954 [Constant] outputs: [onnx::Unsqueeze_1747 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1747 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/0/layers.1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_1747 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/0/layers.1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Concat_1 [Concat] inputs: [/encoder/0/layers.1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/0/layers.1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Concat_1 for ONNX node: /encoder/0/layers.1/self_attn2/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Concat_1 [Concat] outputs: [/encoder/0/layers.1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/0/layers.1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/0/layers.1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/Reshape_1 for ONNX node: /encoder/0/layers.1/self_attn2/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/0/layers.1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9245 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9245 -> (48, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9245 for ONNX node: onnx::MatMul_9245 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/out_proj/MatMul for ONNX node: /encoder/0/layers.1/self_attn2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.self_attn2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/self_attn2/out_proj/Add for ONNX node: /encoder/0/layers.1/self_attn2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/self_attn2/out_proj/Add [Add] outputs: [/encoder/0/layers.1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_5 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass_mid/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_5 [Add] inputs: [/encoder/0/layers.1/bypass_mid/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_5 for ONNX node: /encoder/0/layers.1/Add_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_5_output_0 for ONNX tensor: /encoder/0/layers.1/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_5 [Add] outputs: [/encoder/0/layers.1/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9246 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9246 -> (192, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9246 for ONNX node: onnx::MatMul_9246 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/in_proj/MatMul for ONNX node: /encoder/0/layers.1/conv_module2/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.conv_module2.in_proj.bias -> (384)[FLOAT]], [/encoder/0/layers.1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/in_proj/Add for ONNX node: /encoder/0/layers.1/conv_module2/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/in_proj/Add [Add] outputs: [/encoder/0/layers.1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Shape [Shape] inputs: [/encoder/0/layers.1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Shape for ONNX node: /encoder/0/layers.1/conv_module2/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Shape [Shape] outputs: [/encoder/0/layers.1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Gather [Gather] inputs: [/encoder/0/layers.1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Gather for ONNX node: /encoder/0/layers.1/conv_module2/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Gather [Gather] outputs: [/encoder/0/layers.1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_1 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_2 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Add [Add] inputs: [/encoder/0/layers.1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Add for ONNX node: /encoder/0/layers.1/conv_module2/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Add [Add] outputs: [/encoder/0/layers.1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_3 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Div [Div] inputs: [/encoder/0/layers.1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Div for ONNX node: /encoder/0/layers.1/conv_module2/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Div_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Div [Div] outputs: [/encoder/0/layers.1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_4 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul [Mul] inputs: [/encoder/0/layers.1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Mul for ONNX node: /encoder/0/layers.1/conv_module2/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul [Mul] outputs: [/encoder/0/layers.1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Slice [Slice] inputs: [/encoder/0/layers.1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Slice for ONNX node: /encoder/0/layers.1/conv_module2/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Slice [Slice] outputs: [/encoder/0/layers.1/conv_module2/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_5 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul_1 [Mul] inputs: [/encoder/0/layers.1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Mul_1 for ONNX node: /encoder/0/layers.1/conv_module2/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul_1 [Mul] outputs: [/encoder/0/layers.1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Slice_1 [Slice] inputs: [/encoder/0/layers.1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/0/layers.1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/0/layers.1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Slice_1 for ONNX node: /encoder/0/layers.1/conv_module2/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Slice_1 [Slice] outputs: [/encoder/0/layers.1/conv_module2/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/0/layers.1/conv_module2/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/0/layers.1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul_2 [Mul] inputs: [/encoder/0/layers.1/conv_module2/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Mul_2 for ONNX node: /encoder/0/layers.1/conv_module2/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Mul_2 [Mul] outputs: [/encoder/0/layers.1/conv_module2/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Transpose [Transpose] inputs: [/encoder/0/layers.1/conv_module2/Mul_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Transpose for ONNX node: /encoder/0/layers.1/conv_module2/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Transpose [Transpose] outputs: [/encoder/0/layers.1/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Shape_1 [Shape] inputs: [/encoder/0/layers.1/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Shape_1 for ONNX node: /encoder/0/layers.1/conv_module2/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Shape_1 [Shape] outputs: [/encoder/0/layers.1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Expand [Expand] inputs: [/encoder/0/layers.0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/0/layers.1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Expand for ONNX node: /encoder/0/layers.1/conv_module2/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Expand [Expand] outputs: [/encoder/0/layers.1/conv_module2/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Cast [Cast] inputs: [/encoder/0/layers.1/conv_module2/Expand_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Cast for ONNX node: /encoder/0/layers.1/conv_module2/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Cast [Cast] outputs: [/encoder/0/layers.1/conv_module2/Cast_output_0 -> (-1, 192, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Constant_6 [Constant] outputs: [/encoder/0/layers.1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Where [Where] inputs: [/encoder/0/layers.1/conv_module2/Cast_output_0 -> (-1, 192, -1)[BOOL]], [/encoder/0/layers.1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/0/layers.1/conv_module2/Transpose_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Where for ONNX node: /encoder/0/layers.1/conv_module2/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Where_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Where [Where] outputs: [/encoder/0/layers.1/conv_module2/Where_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/0/layers.1/conv_module2/Where_output_0 -> (-1, 192, -1)[FLOAT]], [encoder.encoders.0.layers.1.conv_module2.depthwise_conv.weight -> (192, 1, 31)[FLOAT]], [encoder.encoders.0.layers.1.conv_module2.depthwise_conv.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Convolution input dimensions: (-1, 192, -1) [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 192, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 192 [07/20/2023-07:25:30] [V] [TRT] Convolution output dimensions: (-1, 192, -1, 1) [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/0/layers.1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/0/layers.1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 192, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/Transpose_1 for ONNX node: /encoder/0/layers.1/conv_module2/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/0/layers.1/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/0/layers.1/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Sub for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Exp for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Add [Add] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Add for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Add [Add] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Log [Log] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Log for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Log [Log] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Cast for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Equal for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Where [Where] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 192)[BOOL]], [/encoder/0/layers.1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Where for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Where [Where] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/0/layers.1/conv_module2/Transpose_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Mul for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9247 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9247 -> (192, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9247 for ONNX node: onnx::MatMul_9247 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/MatMul for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.1.conv_module2.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/0/layers.1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_6 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_6 [Add] inputs: [/encoder/0/layers.1/Add_5_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_6 for ONNX node: /encoder/0/layers.1/Add_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_6_output_0 for ONNX tensor: /encoder/0/layers.1/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_6 [Add] outputs: [/encoder/0/layers.1/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9248 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9248 -> (192, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9248 for ONNX node: onnx::MatMul_9248 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.0.layers.1.feed_forward3.in_proj.bias -> (640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/in_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward3/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Sub for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Exp for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Add for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Log for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Cast for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Equal for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 640)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 640)[BOOL]], [/encoder/0/layers.1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Where for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/0/layers.1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Mul for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 640)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 640)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9249 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/0/layers.1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 640)[FLOAT]], [onnx::MatMul_9249 -> (640, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9249 for ONNX node: onnx::MatMul_9249 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.0.layers.1.feed_forward3.out_proj.bias -> (192)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.0.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/0/layers.1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/0/layers.1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/0/layers.1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/Add_7 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_7 [Add] inputs: [/encoder/0/layers.1/Add_6_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/Add_7 for ONNX node: /encoder/0/layers.1/Add_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/Add_7_output_0 for ONNX tensor: /encoder/0/layers.1/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/Add_7 [Add] outputs: [/encoder/0/layers.1/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Sub [Sub] inputs: [/encoder/0/layers.1/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.1.norm.bias -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.norm.bias for ONNX node: encoder.encoders.0.layers.1.norm.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Sub for ONNX node: /encoder/0/layers.1/norm/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Sub [Sub] outputs: [/encoder/0/layers.1/norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Constant [Constant] outputs: [/encoder/0/layers.1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Pow [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Pow [Pow] inputs: [/encoder/0/layers.1/norm/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Constant_output_0 for ONNX node: /encoder/0/layers.1/norm/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Pow for ONNX node: /encoder/0/layers.1/norm/Pow [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Pow_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Pow [Pow] outputs: [/encoder/0/layers.1/norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Pow_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/ReduceMean [ReduceMean] inputs: [/encoder/0/layers.1/norm/Pow_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/ReduceMean for ONNX node: /encoder/0/layers.1/norm/ReduceMean [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/0/layers.1/norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/ReduceMean [ReduceMean] outputs: [/encoder/0/layers.1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Constant_1 [Constant] outputs: [/encoder/0/layers.1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Pow_1 [Pow] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/ReduceMean_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Pow_1 [Pow] inputs: [/encoder/0/layers.1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/0/layers.1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Constant_1_output_0 for ONNX node: /encoder/0/layers.1/norm/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Pow_1 for ONNX node: /encoder/0/layers.1/norm/Pow_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Pow_1_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Pow_1 [Pow] outputs: [/encoder/0/layers.1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Exp [Exp] inputs: [encoder.encoders.0.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.norm.log_scale for ONNX node: encoder.encoders.0.layers.1.norm.log_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Exp for ONNX node: /encoder/0/layers.1/norm/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Exp_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Exp [Exp] outputs: [/encoder/0/layers.1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Pow_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Mul [Mul] inputs: [/encoder/0/layers.1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/0/layers.1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Mul for ONNX node: /encoder/0/layers.1/norm/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Mul [Mul] outputs: [/encoder/0/layers.1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/norm/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/Add_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Mul_1 [Mul] inputs: [/encoder/0/layers.1/Add_7_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/norm/Mul_1 for ONNX node: /encoder/0/layers.1/norm/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/norm/Mul_1_output_0 for ONNX tensor: /encoder/0/layers.1/norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/norm/Mul_1 [Mul] outputs: [/encoder/0/layers.1/norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/norm/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Sub [Sub] inputs: [/encoder/0/layers.1/norm/Mul_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass/Sub for ONNX node: /encoder/0/layers.1/bypass/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass/Sub_output_0 for ONNX tensor: /encoder/0/layers.1/bypass/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Sub [Sub] outputs: [/encoder/0/layers.1/bypass/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.0.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Mul [Mul] inputs: [/encoder/0/layers.1/bypass/Sub_output_0 -> (-1, -1, 192)[FLOAT]], [encoder.encoders.0.layers.1.bypass.bypass_scale -> (192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.0.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.0.layers.1.bypass.bypass_scale [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass/Mul for ONNX node: /encoder/0/layers.1/bypass/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass/Mul_output_0 for ONNX tensor: /encoder/0/layers.1/bypass/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Mul [Mul] outputs: [/encoder/0/layers.1/bypass/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/0/layers.1/bypass/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.0/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Add [Add] inputs: [/encoder/0/layers.0/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/0/layers.1/bypass/Mul_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/0/layers.1/bypass/Add for ONNX node: /encoder/0/layers.1/bypass/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/0/layers.1/bypass/Add_output_0 for ONNX tensor: /encoder/0/layers.1/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/0/layers.1/bypass/Add [Add] outputs: [/encoder/0/layers.1/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape [Shape] inputs: [/encoder/0/layers.1/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Shape for ONNX node: /encoder/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Shape_output_0 for ONNX tensor: /encoder/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape [Shape] outputs: [/encoder/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_4 [Constant] outputs: [/encoder/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather [Gather] inputs: [/encoder/Shape_output_0 -> (3)[INT32]], [/encoder/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Constant_4_output_0 for ONNX node: /encoder/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Gather for ONNX node: /encoder/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Gather_output_0 for ONNX tensor: /encoder/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather [Gather] outputs: [/encoder/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape_1 [Shape] inputs: [/encoder/0/layers.1/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Shape_1 for ONNX node: /encoder/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Shape_1_output_0 for ONNX tensor: /encoder/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape_1 [Shape] outputs: [/encoder/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_5 [Constant] outputs: [/encoder/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather_1 [Gather] inputs: [/encoder/Shape_1_output_0 -> (3)[INT32]], [/encoder/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Constant_5_output_0 for ONNX node: /encoder/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Gather_1 for ONNX node: /encoder/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Gather_1_output_0 for ONNX tensor: /encoder/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather_1 [Gather] outputs: [/encoder/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape_2 [Shape] inputs: [/encoder/0/layers.1/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Shape_2 for ONNX node: /encoder/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Shape_2_output_0 for ONNX tensor: /encoder/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Shape_2 [Shape] outputs: [/encoder/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_6 [Constant] outputs: [/encoder/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather_2 [Gather] inputs: [/encoder/Shape_2_output_0 -> (3)[INT32]], [/encoder/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Constant_6_output_0 for ONNX node: /encoder/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Gather_2 for ONNX node: /encoder/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Gather_2_output_0 for ONNX tensor: /encoder/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Gather_2 [Gather] outputs: [/encoder/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_7 [Constant] outputs: [/encoder/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Sub [Sub] inputs: [/encoder/Constant_7_output_0 -> ()[INT32]], [/encoder/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Constant_7_output_0 for ONNX node: /encoder/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Sub for ONNX node: /encoder/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Sub_output_0 for ONNX tensor: /encoder/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Sub [Sub] outputs: [/encoder/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1048 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1048 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1048 [Constant] outputs: [onnx::Unsqueeze_1846 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1846 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze [Unsqueeze] inputs: [/encoder/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1846 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Unsqueeze for ONNX node: /encoder/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Unsqueeze_output_0 for ONNX tensor: /encoder/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze [Unsqueeze] outputs: [/encoder/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1050 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1050 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1050 [Constant] outputs: [onnx::Unsqueeze_1848 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1848 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1848 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Unsqueeze_1 for ONNX node: /encoder/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Unsqueeze_1_output_0 for ONNX tensor: /encoder/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1052 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1052 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1052 [Constant] outputs: [onnx::Unsqueeze_1850 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1850 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_1850 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Unsqueeze_2 for ONNX node: /encoder/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Unsqueeze_2_output_0 for ONNX tensor: /encoder/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Concat [Concat] inputs: [/encoder/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Concat for ONNX node: /encoder/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Concat_output_0 for ONNX tensor: /encoder/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Concat [Concat] outputs: [/encoder/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/ConstantOfShape [ConstantOfShape] inputs: [/encoder/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/ConstantOfShape_output_0 for ONNX tensor: /encoder/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/ConstantOfShape [ConstantOfShape] outputs: [/encoder/ConstantOfShape_output_0 -> (-1, -1, 64)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/0/layers.1/bypass/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Concat_1 [Concat] inputs: [/encoder/0/layers.1/bypass/Add_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/ConstantOfShape_output_0 -> (-1, -1, 64)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Concat_1 for ONNX node: /encoder/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Concat_1_output_0 for ONNX tensor: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Concat_1 [Concat] outputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_8 [Constant] outputs: [/encoder/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_9 [Constant] outputs: [/encoder/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_10 [Constant] outputs: [/encoder/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/Constant_11 [Constant] outputs: [/encoder/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /GreaterOrEqual_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Slice_1 [Slice] inputs: [/GreaterOrEqual_output_0 -> (-1, -1)[BOOL]], [/encoder/Constant_9_output_0 -> (1)[INT32]], [/encoder/Constant_10_output_0 -> (1)[INT32]], [/encoder/Constant_8_output_0 -> (1)[INT32]], [/encoder/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/Slice_1 for ONNX node: /encoder/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/Slice_1_output_0 for ONNX tensor: /encoder/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/Slice_1 [Slice] outputs: [/encoder/Slice_1_output_0 -> (-1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape [Shape] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Shape for ONNX node: /encoder/1/downsample/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Shape_output_0 for ONNX tensor: /encoder/1/downsample/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape [Shape] outputs: [/encoder/1/downsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant [Constant] outputs: [/encoder/1/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather [Gather] inputs: [/encoder/1/downsample/Shape_output_0 -> (3)[INT32]], [/encoder/1/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_output_0 for ONNX node: /encoder/1/downsample/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Gather for ONNX node: /encoder/1/downsample/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Gather_output_0 for ONNX tensor: /encoder/1/downsample/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather [Gather] outputs: [/encoder/1/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_1 [Shape] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Shape_1 for ONNX node: /encoder/1/downsample/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Shape_1_output_0 for ONNX tensor: /encoder/1/downsample/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_1 [Shape] outputs: [/encoder/1/downsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_1 [Constant] outputs: [/encoder/1/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather_1 [Gather] inputs: [/encoder/1/downsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_1_output_0 for ONNX node: /encoder/1/downsample/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Gather_1 for ONNX node: /encoder/1/downsample/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Gather_1_output_0 for ONNX tensor: /encoder/1/downsample/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather_1 [Gather] outputs: [/encoder/1/downsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_2 [Shape] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Shape_2 for ONNX node: /encoder/1/downsample/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Shape_2_output_0 for ONNX tensor: /encoder/1/downsample/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_2 [Shape] outputs: [/encoder/1/downsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_2 [Constant] outputs: [/encoder/1/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather_2 [Gather] inputs: [/encoder/1/downsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/1/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_2_output_0 for ONNX node: /encoder/1/downsample/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Gather_2 for ONNX node: /encoder/1/downsample/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Gather_2_output_0 for ONNX tensor: /encoder/1/downsample/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Gather_2 [Gather] outputs: [/encoder/1/downsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_3 [Constant] outputs: [/encoder/1/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Add [Add] inputs: [/encoder/1/downsample/Gather_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_3_output_0 for ONNX node: /encoder/1/downsample/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Add for ONNX node: /encoder/1/downsample/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Add_output_0 for ONNX tensor: /encoder/1/downsample/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Add [Add] outputs: [/encoder/1/downsample/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_4 [Constant] outputs: [/encoder/1/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub [Sub] inputs: [/encoder/1/downsample/Add_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_4_output_0 for ONNX node: /encoder/1/downsample/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Sub for ONNX node: /encoder/1/downsample/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Sub_output_0 for ONNX tensor: /encoder/1/downsample/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub [Sub] outputs: [/encoder/1/downsample/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_5 [Constant] outputs: [/encoder/1/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Div [Div] inputs: [/encoder/1/downsample/Sub_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_5_output_0 for ONNX node: /encoder/1/downsample/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Div for ONNX node: /encoder/1/downsample/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Div_output_0 for ONNX tensor: /encoder/1/downsample/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Div [Div] outputs: [/encoder/1/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Cast [Cast] inputs: [/encoder/1/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Cast for ONNX node: /encoder/1/downsample/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Cast_output_0 for ONNX tensor: /encoder/1/downsample/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Cast [Cast] outputs: [/encoder/1/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Cast_1 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Cast_1 [Cast] inputs: [/encoder/1/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Cast_1 for ONNX node: /encoder/1/downsample/Cast_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Cast_1_output_0 for ONNX tensor: /encoder/1/downsample/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Cast_1 [Cast] outputs: [/encoder/1/downsample/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_6 [Constant] outputs: [/encoder/1/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul [Mul] inputs: [/encoder/1/downsample/Cast_1_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_6_output_0 for ONNX node: /encoder/1/downsample/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Mul for ONNX node: /encoder/1/downsample/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Mul_output_0 for ONNX tensor: /encoder/1/downsample/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul [Mul] outputs: [/encoder/1/downsample/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub_1 [Sub] inputs: [/encoder/1/downsample/Mul_output_0 -> ()[INT32]], [/encoder/1/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Sub_1 for ONNX node: /encoder/1/downsample/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Sub_1_output_0 for ONNX tensor: /encoder/1/downsample/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub_1 [Sub] outputs: [/encoder/1/downsample/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_7 [Constant] outputs: [/encoder/1/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub_2 [Sub] inputs: [/encoder/1/downsample/Gather_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_7_output_0 for ONNX node: /encoder/1/downsample/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Sub_2 for ONNX node: /encoder/1/downsample/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Sub_2_output_0 for ONNX tensor: /encoder/1/downsample/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Sub_2 [Sub] outputs: [/encoder/1/downsample/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_8 [Constant] outputs: [/encoder/1/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze [Unsqueeze] inputs: [/encoder/1/downsample/Sub_2_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze for ONNX node: /encoder/1/downsample/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_9 [Constant] outputs: [/encoder/1/downsample/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_10 [Constant] outputs: [/encoder/1/downsample/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_11 [Constant] outputs: [/encoder/1/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Slice [Slice] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/downsample/Constant_9_output_0 -> (1)[INT32]], [/encoder/1/downsample/Constant_10_output_0 -> (1)[INT32]], [/encoder/1/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Slice for ONNX node: /encoder/1/downsample/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Slice_output_0 for ONNX tensor: /encoder/1/downsample/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Slice [Slice] outputs: [/encoder/1/downsample/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_12 [Constant] outputs: [/encoder/1/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/downsample/Sub_1_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_1 for ONNX node: /encoder/1/downsample/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_13 [Constant] outputs: [/encoder/1/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/downsample/Gather_1_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_2 for ONNX node: /encoder/1/downsample/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_14 [Constant] outputs: [/encoder/1/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/downsample/Gather_2_output_0 -> ()[INT32]], [/encoder/1/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_3 for ONNX node: /encoder/1/downsample/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat [Concat] inputs: [/encoder/1/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Concat for ONNX node: /encoder/1/downsample/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Concat_output_0 for ONNX tensor: /encoder/1/downsample/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat [Concat] outputs: [/encoder/1/downsample/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_15 [Constant] outputs: [/encoder/1/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Reshape [Reshape] inputs: [/encoder/1/downsample/Concat_output_0 -> (3)[INT32]], [/encoder/1/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Reshape for ONNX node: /encoder/1/downsample/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Reshape_output_0 for ONNX tensor: /encoder/1/downsample/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Reshape [Reshape] outputs: [/encoder/1/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_3 [Shape] inputs: [/encoder/1/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Shape_3 for ONNX node: /encoder/1/downsample/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Shape_3_output_0 for ONNX tensor: /encoder/1/downsample/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Shape_3 [Shape] outputs: [/encoder/1/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/1/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/1/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/1/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_16 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_16 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_16 [Constant] outputs: [/encoder/1/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul_1 [Mul] inputs: [/encoder/1/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/1/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_16_output_0 for ONNX node: /encoder/1/downsample/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Mul_1 for ONNX node: /encoder/1/downsample/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Mul_1_output_0 for ONNX tensor: /encoder/1/downsample/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul_1 [Mul] outputs: [/encoder/1/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Equal [Equal] inputs: [/encoder/1/downsample/Reshape_output_0 -> (3)[INT32]], [/encoder/1/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Equal for ONNX node: /encoder/1/downsample/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Equal_output_0 for ONNX tensor: /encoder/1/downsample/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Equal [Equal] outputs: [/encoder/1/downsample/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Where [Where] inputs: [/encoder/1/downsample/Equal_output_0 -> (3)[BOOL]], [/encoder/1/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/1/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Where for ONNX node: /encoder/1/downsample/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Where_output_0 for ONNX tensor: /encoder/1/downsample/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Where [Where] outputs: [/encoder/1/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Expand [Expand] inputs: [/encoder/1/downsample/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Expand for ONNX node: /encoder/1/downsample/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Expand_output_0 for ONNX tensor: /encoder/1/downsample/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Expand [Expand] outputs: [/encoder/1/downsample/Expand_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat_1 [Concat] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/Expand_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Concat_1 for ONNX node: /encoder/1/downsample/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Concat_1_output_0 for ONNX tensor: /encoder/1/downsample/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat_1 [Concat] outputs: [/encoder/1/downsample/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1107 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1107 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1107 [Constant] outputs: [onnx::Unsqueeze_1907 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1907 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/downsample/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1907 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_4 for ONNX node: /encoder/1/downsample/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Constant_17 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_17 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Constant_17 [Constant] outputs: [/encoder/1/downsample/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1110 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1110 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1110 [Constant] outputs: [onnx::Unsqueeze_1911 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1911 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/downsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1911 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_5 for ONNX node: /encoder/1/downsample/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1112 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1112 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1112 [Constant] outputs: [onnx::Unsqueeze_1913 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1913 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/downsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_1913 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Unsqueeze_6 for ONNX node: /encoder/1/downsample/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat_2 [Concat] inputs: [/encoder/1/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/downsample/Constant_17_output_0 -> (1)[INT32]], [/encoder/1/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Constant_17_output_0 for ONNX node: /encoder/1/downsample/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Concat_2 for ONNX node: /encoder/1/downsample/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Concat_2_output_0 for ONNX tensor: /encoder/1/downsample/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Concat_2 [Concat] outputs: [/encoder/1/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Reshape_1 [Reshape] inputs: [/encoder/1/downsample/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Reshape_1 for ONNX node: /encoder/1/downsample/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Reshape_1_output_0 for ONNX tensor: /encoder/1/downsample/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Reshape_1 [Reshape] outputs: [/encoder/1/downsample/Reshape_1_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Softmax [Softmax] [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Softmax_9254 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Softmax [Softmax] inputs: [onnx::Softmax_9254 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::Softmax_9254 for ONNX node: onnx::Softmax_9254 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Softmax for ONNX node: /encoder/1/downsample/Softmax [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Softmax_output_0 for ONNX tensor: /encoder/1/downsample/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Softmax [Softmax] outputs: [/encoder/1/downsample/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul_2 [Mul] inputs: [/encoder/1/downsample/Reshape_1_output_0 -> (-1, 2, -1, 256)[FLOAT]], [/encoder/1/downsample/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/Mul_2 for ONNX node: /encoder/1/downsample/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/Mul_2_output_0 for ONNX tensor: /encoder/1/downsample/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/Mul_2 [Mul] outputs: [/encoder/1/downsample/Mul_2_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/downsample/ReduceSum [ReduceSum] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/ReduceSum [ReduceSum] inputs: [/encoder/1/downsample/Mul_2_output_0 -> (-1, 2, -1, 256)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/downsample/ReduceSum for ONNX node: /encoder/1/downsample/ReduceSum [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/downsample/ReduceSum_output_0 for ONNX tensor: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/downsample/ReduceSum [ReduceSum] outputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Shape [Shape] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Shape for ONNX node: /encoder/1/encoder/encoder_pos/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Shape [Shape] outputs: [/encoder/1/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_1 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Gather [Gather] inputs: [/encoder/1/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/1/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Gather for ONNX node: /encoder/1/encoder/encoder_pos/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Gather [Gather] outputs: [/encoder/1/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_2 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Sub [Sub] inputs: [/encoder/1/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/1/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/1/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Sub for ONNX node: /encoder/1/encoder/encoder_pos/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Sub [Sub] outputs: [/encoder/1/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_3 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Add [Add] inputs: [/encoder/1/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/1/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/1/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Add for ONNX node: /encoder/1/encoder/encoder_pos/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Add_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Add [Add] outputs: [/encoder/1/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_4 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Add_1 [Add] inputs: [/encoder/1/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/1/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/1/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Add_1 for ONNX node: /encoder/1/encoder/encoder_pos/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Add_1 [Add] outputs: [/encoder/1/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_5 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/1/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Unsqueeze for ONNX node: /encoder/1/encoder/encoder_pos/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_6 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/1/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/1/encoder/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_7 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_8 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Slice [Slice] inputs: [/encoder/1/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/1/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/1/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Constant_output_0 for ONNX node: /encoder/1/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Slice for ONNX node: /encoder/1/encoder/encoder_pos/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Slice [Slice] outputs: [/encoder/1/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Constant_9 [Constant] outputs: [/encoder/1/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/1/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/1/encoder/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9256 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9256 -> (256, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9256 for ONNX node: onnx::MatMul_9256 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/in_proj/Add for ONNX node: /encoder/1/encoder/0/self_attn_weights/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice [Slice] inputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Slice for ONNX node: /encoder/1/encoder/0/self_attn_weights/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice [Slice] outputs: [/encoder/1/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Slice_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/1/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/1/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Slice_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/1/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1161 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1161 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1161 [Constant] outputs: [onnx::Unsqueeze_1968 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1968 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1968 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1163 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1163 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1163 [Constant] outputs: [onnx::Unsqueeze_1970 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1970 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1970 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1168 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1168 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1168 [Constant] outputs: [onnx::Unsqueeze_1977 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1977 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1977 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1170 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1170 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1170 [Constant] outputs: [onnx::Unsqueeze_1979 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1979 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1979 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1176 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1176 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1176 [Constant] outputs: [onnx::Unsqueeze_1987 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1987 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_1987 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1178 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1178 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1178 [Constant] outputs: [onnx::Unsqueeze_1989 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_1989 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_1989 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Transpose for ONNX node: /encoder/1/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Transpose_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Transpose_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/MatMul for ONNX node: /encoder/1/encoder/0/self_attn_weights/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9263 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9263 -> (48, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9263 for ONNX node: onnx::MatMul_9263 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Mul [Mul] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Mul for ONNX node: /encoder/1/encoder/0/self_attn_weights/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Mul [Mul] outputs: [/encoder/1/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Sub [Sub] inputs: [/encoder/1/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Sub for ONNX node: /encoder/1/encoder/0/self_attn_weights/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Sub [Sub] outputs: [/encoder/1/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1195 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1195 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1195 [Constant] outputs: [onnx::Unsqueeze_2010 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2010 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_2010 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Transpose_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/1/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/MatMul_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/MatMul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather_3 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_4 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather_4 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_5 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Gather_5 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/1/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Sub_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Cast for ONNX node: /encoder/1/encoder/0/self_attn_weights/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast [Cast] outputs: [/encoder/1/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Range [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Range [Range] inputs: [/encoder/1/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Range for ONNX node: /encoder/1/encoder/0/self_attn_weights/Range [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Range [Range] outputs: [/encoder/1/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Cast_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Cast_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/1/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Range_1 [Range] inputs: [/encoder/1/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Range_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Range_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Range_1 [Range] outputs: [/encoder/1/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Mul_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1226 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1226 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1226 [Constant] outputs: [onnx::Unsqueeze_2043 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2043 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2043 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_4 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1229 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1229 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1229 [Constant] outputs: [onnx::Unsqueeze_2046 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2046 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2046 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_5 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Shape_6 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Shape_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/1/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/1/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/1/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Expand for ONNX node: /encoder/1/encoder/0/self_attn_weights/Expand [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Expand [Expand] outputs: [/encoder/1/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Tile [Tile] inputs: [/encoder/1/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Tile for ONNX node: /encoder/1/encoder/0/self_attn_weights/Tile [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Tile [Tile] outputs: [/encoder/1/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Add [Add] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Add for ONNX node: /encoder/1/encoder/0/self_attn_weights/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Add [Add] outputs: [/encoder/1/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1240 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1240 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1240 [Constant] outputs: [onnx::Unsqueeze_2058 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2058 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_2058 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_6 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_6 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape_4 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/GatherElements for ONNX node: /encoder/1/encoder/0/self_attn_weights/GatherElements [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/1/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1245 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1245 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1245 [Constant] outputs: [onnx::Unsqueeze_2063 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2063 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2063 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1247 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1247 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1247 [Constant] outputs: [onnx::Unsqueeze_2065 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2065 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2065 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1249 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1249 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1249 [Constant] outputs: [onnx::Unsqueeze_2067 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2067 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2067 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1251 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1251 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1251 [Constant] outputs: [onnx::Unsqueeze_2069 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2069 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2069 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Concat_7 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Concat_7 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/1/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/1/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Reshape_5 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Reshape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/1/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Add_1 [Add] inputs: [/encoder/1/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Add_1 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Add_1 [Add] outputs: [/encoder/1/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] inputs: [/encoder/Slice_1_output_0 -> (-1, -1)[BOOL]], [/encoder/1/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: bool [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Cast_2 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Cast_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/1/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Constant_37 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_37 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Constant_37 [Constant] outputs: [/encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Where [Where] inputs: [/encoder/1/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [/encoder/1/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 for ONNX node: /encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Where for ONNX node: /encoder/1/encoder/0/self_attn_weights/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Where [Where] outputs: [/encoder/1/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/1/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn_weights/Softmax for ONNX node: /encoder/1/encoder/0/self_attn_weights/Softmax [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/1/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9270 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9270 -> (256, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9270 for ONNX node: onnx::MatMul_9270 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias -> (576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/in_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward1/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Sub for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Exp for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Exp [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Log for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Log [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Cast for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Cast [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Equal for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Equal [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Where for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Where [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Mul for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9271 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [onnx::MatMul_9271 -> (576, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9271 for ONNX node: onnx::MatMul_9271 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Add [Add] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add for ONNX node: /encoder/1/encoder/0/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Add [Add] outputs: [/encoder/1/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant [Constant] outputs: [/encoder/1/encoder/0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Slice [Slice] inputs: [/encoder/1/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/Constant_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/Constant_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/Slice for ONNX node: /encoder/1/encoder/0/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Slice_output_0 for ONNX tensor: /encoder/1/encoder/0/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/Slice [Slice] outputs: [/encoder/1/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::MatMul_9272 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9272 -> (256, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: onnx::MatMul_9272 for ONNX node: onnx::MatMul_9272 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias -> (576)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/in_proj/Add for ONNX node: /encoder/1/encoder/0/nonlin_attention/in_proj/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape [Shape] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Add [Add] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Add [Add] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Add for ONNX node: /encoder/1/encoder/0/nonlin_attention/Add [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Add [Add] outputs: [/encoder/1/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Div [Div] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Div [Div] inputs: [/encoder/1/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Div for ONNX node: /encoder/1/encoder/0/nonlin_attention/Div [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Div [Div] outputs: [/encoder/1/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul [Mul] inputs: [/encoder/1/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Mul for ONNX node: /encoder/1/encoder/0/nonlin_attention/Mul [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul [Mul] outputs: [/encoder/1/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice [Slice] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Slice for ONNX node: /encoder/1/encoder/0/nonlin_attention/Slice [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice [Slice] outputs: [/encoder/1/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/1/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Mul_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Mul_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Slice_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Slice_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/1/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/1/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Mul_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Mul_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/1/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/1/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Slice_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Slice_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/1/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/1/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/1/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (_, _, 192), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1315 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1315 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1315 [Constant] outputs: [onnx::Unsqueeze_2136 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2136 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2136 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1317 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1317 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1317 [Constant] outputs: [onnx::Unsqueeze_2138 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2138 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2138 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat [Concat] inputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Concat for ONNX node: /encoder/1/encoder/0/nonlin_attention/Concat [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat [Concat] outputs: [/encoder/1/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Reshape for ONNX node: /encoder/1/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/1/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/1/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Mul_3 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Mul_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape_3 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather_3 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape_4 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather_4 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/Slice_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/1/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Shape_5 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Shape_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/1/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/1/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:30] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Gather_5 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Gather_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/1/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1332 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1332 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1332 [Constant] outputs: [onnx::Unsqueeze_2154 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2154 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2154 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1334 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1334 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1334 [Constant] outputs: [onnx::Unsqueeze_2156 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2156 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2156 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: Constant_1336 [Constant] [07/20/2023-07:25:30] [V] [TRT] Constant_1336 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] Constant_1336 [Constant] outputs: [onnx::Unsqueeze_2158 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: onnx::Unsqueeze_2158 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_2158 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Concat_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Concat_1 [07/20/2023-07:25:30] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/1/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:30] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:30] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:30] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Reshape_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/1/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Transpose for ONNX node: /encoder/1/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/1/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/MatMul for ONNX node: /encoder/1/encoder/0/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/1/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Transpose_1 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1344 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1344 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1344 [Constant] outputs: [onnx::Unsqueeze_2167 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2167 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2167 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1346 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1346 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1346 [Constant] outputs: [onnx::Unsqueeze_2169 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2169 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/1/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2169 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/1/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Concat_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/1/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/1/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Reshape_2 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/1/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/1/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/Mul_4 for ONNX node: /encoder/1/encoder/0/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/1/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9276 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9276 -> (192, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9276 for ONNX node: onnx::MatMul_9276 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/nonlin_attention/out_proj/Add for ONNX node: /encoder/1/encoder/0/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_1 [Add] inputs: [/encoder/1/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_1 for ONNX node: /encoder/1/encoder/0/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_1 [Add] outputs: [/encoder/1/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape [Shape] inputs: [/encoder/1/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Shape for ONNX node: /encoder/1/encoder/0/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape [Shape] outputs: [/encoder/1/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant [Constant] outputs: [/encoder/1/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather [Gather] inputs: [/encoder/1/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Constant_output_0 for ONNX node: /encoder/1/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Gather for ONNX node: /encoder/1/encoder/0/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather [Gather] outputs: [/encoder/1/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Shape_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_1 [Gather] inputs: [/encoder/1/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Gather_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_1 [Gather] outputs: [/encoder/1/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_2 [Shape] inputs: [/encoder/1/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Shape_2 for ONNX node: /encoder/1/encoder/0/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_2 [Shape] outputs: [/encoder/1/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_2 [Gather] inputs: [/encoder/1/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Gather_2 for ONNX node: /encoder/1/encoder/0/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_2 [Gather] outputs: [/encoder/1/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9277 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9277 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9277 for ONNX node: onnx::MatMul_9277 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/1/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/in_proj/Add for ONNX node: /encoder/1/encoder/0/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1366 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1366 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1366 [Constant] outputs: [onnx::Unsqueeze_2192 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2192 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2192 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1368 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1368 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1368 [Constant] outputs: [onnx::Unsqueeze_2194 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2194 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2194 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1370 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1370 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1370 [Constant] outputs: [onnx::Unsqueeze_2196 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2196 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2196 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Concat [Concat] inputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Concat for ONNX node: /encoder/1/encoder/0/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Concat [Concat] outputs: [/encoder/1/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Reshape [Reshape] inputs: [/encoder/1/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/1/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Reshape for ONNX node: /encoder/1/encoder/0/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Reshape [Reshape] outputs: [/encoder/1/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Transpose [Transpose] inputs: [/encoder/1/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Transpose for ONNX node: /encoder/1/encoder/0/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Transpose [Transpose] outputs: [/encoder/1/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_3 [Shape] inputs: [/encoder/1/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Shape_3 for ONNX node: /encoder/1/encoder/0/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Shape_3 [Shape] outputs: [/encoder/1/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_3 [Gather] inputs: [/encoder/1/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Gather_3 for ONNX node: /encoder/1/encoder/0/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Gather_3 [Gather] outputs: [/encoder/1/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/MatMul [MatMul] inputs: [/encoder/1/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/MatMul for ONNX node: /encoder/1/encoder/0/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Transpose_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Mul [Mul] inputs: [/encoder/1/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Mul for ONNX node: /encoder/1/encoder/0/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Mul [Mul] outputs: [/encoder/1/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1382 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1382 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1382 [Constant] outputs: [onnx::Unsqueeze_2209 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2209 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2209 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1384 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1384 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1384 [Constant] outputs: [onnx::Unsqueeze_2211 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2211 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2211 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1386 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1386 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1386 [Constant] outputs: [onnx::Unsqueeze_2213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2213 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_2213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/1/encoder/0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Concat_1 [Concat] inputs: [/encoder/1/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Concat_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Concat_1 [Concat] outputs: [/encoder/1/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/1/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/Reshape_1 for ONNX node: /encoder/1/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9279 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9279 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9279 for ONNX node: onnx::MatMul_9279 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn1/out_proj/Add for ONNX node: /encoder/1/encoder/0/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn1/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_2 [Add] inputs: [/encoder/1/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_2 for ONNX node: /encoder/1/encoder/0/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_2_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_2 [Add] outputs: [/encoder/1/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9280 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9280 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9280 for ONNX node: onnx::MatMul_9280 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias -> (512)[FLOAT]], [/encoder/1/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/in_proj/Add for ONNX node: /encoder/1/encoder/0/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Shape [Shape] inputs: [/encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Shape for ONNX node: /encoder/1/encoder/0/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Shape [Shape] outputs: [/encoder/1/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Gather [Gather] inputs: [/encoder/1/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Gather for ONNX node: /encoder/1/encoder/0/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Gather [Gather] outputs: [/encoder/1/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Add [Add] inputs: [/encoder/1/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Add for ONNX node: /encoder/1/encoder/0/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Add [Add] outputs: [/encoder/1/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Div [Div] inputs: [/encoder/1/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Div for ONNX node: /encoder/1/encoder/0/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Div_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Div [Div] outputs: [/encoder/1/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul [Mul] inputs: [/encoder/1/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Mul for ONNX node: /encoder/1/encoder/0/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul [Mul] outputs: [/encoder/1/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Slice [Slice] inputs: [/encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Slice for ONNX node: /encoder/1/encoder/0/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Slice [Slice] outputs: [/encoder/1/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_5 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul_1 [Mul] inputs: [/encoder/1/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Mul_1 for ONNX node: /encoder/1/encoder/0/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul_1 [Mul] outputs: [/encoder/1/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Slice_1 [Slice] inputs: [/encoder/1/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Slice_1 for ONNX node: /encoder/1/encoder/0/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Slice_1 [Slice] outputs: [/encoder/1/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/1/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul_2 [Mul] inputs: [/encoder/1/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Mul_2 for ONNX node: /encoder/1/encoder/0/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Mul_2 [Mul] outputs: [/encoder/1/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Transpose [Transpose] inputs: [/encoder/1/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Transpose for ONNX node: /encoder/1/encoder/0/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Transpose [Transpose] outputs: [/encoder/1/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Shape_1 for ONNX node: /encoder/1/encoder/0/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Expand for ONNX node: /encoder/1/encoder/0/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Expand [Expand] outputs: [/encoder/1/encoder/0/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Cast [Cast] inputs: [/encoder/1/encoder/0/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Cast for ONNX node: /encoder/1/encoder/0/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Cast [Cast] outputs: [/encoder/1/encoder/0/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Constant_6 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Where [Where] inputs: [/encoder/1/encoder/0/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/1/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/1/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Where for ONNX node: /encoder/1/encoder/0/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Where [Where] outputs: [/encoder/1/encoder/0/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/1/encoder/0/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.1.encoder.layers.0.conv_module1.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/Transpose_1 for ONNX node: /encoder/1/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Sub for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Exp for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Add [Add] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Add for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Log [Log] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Log for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Log [Log] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Cast for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Equal for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Where [Where] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/1/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Where for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Where [Where] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Mul for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9281 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9281 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9281 for ONNX node: onnx::MatMul_9281 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/1/encoder/0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_3 [Add] inputs: [/encoder/1/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_3 for ONNX node: /encoder/1/encoder/0/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_3_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_3 [Add] outputs: [/encoder/1/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9282 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9282 -> (256, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9282 for ONNX node: onnx::MatMul_9282 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias -> (768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/in_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Sub for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Exp for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Log for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Cast for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Equal for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Where for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Mul for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9283 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9283 -> (768, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9283 for ONNX node: onnx::MatMul_9283 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_4 [Add] inputs: [/encoder/1/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_4 for ONNX node: /encoder/1/encoder/0/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_4_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_4 [Add] outputs: [/encoder/1/encoder/0/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Sub [Sub] inputs: [/encoder/1/encoder/0/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass_mid/Sub for ONNX node: /encoder/1/encoder/0/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Sub [Sub] outputs: [/encoder/1/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Mul [Mul] inputs: [/encoder/1/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass_mid/Mul for ONNX node: /encoder/1/encoder/0/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Mul [Mul] outputs: [/encoder/1/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Add [Add] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass_mid/Add for ONNX node: /encoder/1/encoder/0/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass_mid/Add [Add] outputs: [/encoder/1/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape [Shape] inputs: [/encoder/1/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Shape for ONNX node: /encoder/1/encoder/0/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape [Shape] outputs: [/encoder/1/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant [Constant] outputs: [/encoder/1/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather [Gather] inputs: [/encoder/1/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Constant_output_0 for ONNX node: /encoder/1/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Gather for ONNX node: /encoder/1/encoder/0/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather [Gather] outputs: [/encoder/1/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Shape_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather_1 [Gather] inputs: [/encoder/1/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Gather_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather_1 [Gather] outputs: [/encoder/1/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9284 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9284 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9284 for ONNX node: onnx::MatMul_9284 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/1/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/in_proj/Add for ONNX node: /encoder/1/encoder/0/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1468 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1468 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1468 [Constant] outputs: [onnx::Unsqueeze_2301 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2301 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2301 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1470 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1470 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1470 [Constant] outputs: [onnx::Unsqueeze_2303 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2303 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2303 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1472 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1472 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1472 [Constant] outputs: [onnx::Unsqueeze_2305 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2305 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2305 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Concat [Concat] inputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Concat for ONNX node: /encoder/1/encoder/0/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Concat [Concat] outputs: [/encoder/1/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Reshape [Reshape] inputs: [/encoder/1/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/1/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Reshape for ONNX node: /encoder/1/encoder/0/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Reshape [Reshape] outputs: [/encoder/1/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Transpose [Transpose] inputs: [/encoder/1/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Transpose for ONNX node: /encoder/1/encoder/0/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Transpose [Transpose] outputs: [/encoder/1/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape_2 [Shape] inputs: [/encoder/1/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Shape_2 for ONNX node: /encoder/1/encoder/0/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Shape_2 [Shape] outputs: [/encoder/1/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather_2 [Gather] inputs: [/encoder/1/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Gather_2 for ONNX node: /encoder/1/encoder/0/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Gather_2 [Gather] outputs: [/encoder/1/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/MatMul [MatMul] inputs: [/encoder/1/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/MatMul for ONNX node: /encoder/1/encoder/0/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Transpose_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Mul [Mul] inputs: [/encoder/1/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/1/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Mul for ONNX node: /encoder/1/encoder/0/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Mul [Mul] outputs: [/encoder/1/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1484 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1484 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1484 [Constant] outputs: [onnx::Unsqueeze_2318 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2318 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2318 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1486 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1486 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1486 [Constant] outputs: [onnx::Unsqueeze_2320 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2320 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2320 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1488 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1488 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1488 [Constant] outputs: [onnx::Unsqueeze_2322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2322 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_2322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/1/encoder/0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Concat_1 [Concat] inputs: [/encoder/1/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Concat_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Concat_1 [Concat] outputs: [/encoder/1/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/1/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/Reshape_1 for ONNX node: /encoder/1/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9286 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9286 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9286 for ONNX node: onnx::MatMul_9286 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/self_attn2/out_proj/Add for ONNX node: /encoder/1/encoder/0/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/self_attn2/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_5 [Add] inputs: [/encoder/1/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_5 for ONNX node: /encoder/1/encoder/0/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_5_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_5 [Add] outputs: [/encoder/1/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9287 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9287 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9287 for ONNX node: onnx::MatMul_9287 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias -> (512)[FLOAT]], [/encoder/1/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/in_proj/Add for ONNX node: /encoder/1/encoder/0/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Shape [Shape] inputs: [/encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Shape for ONNX node: /encoder/1/encoder/0/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Shape [Shape] outputs: [/encoder/1/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Gather [Gather] inputs: [/encoder/1/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Gather for ONNX node: /encoder/1/encoder/0/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Gather [Gather] outputs: [/encoder/1/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Add [Add] inputs: [/encoder/1/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Add for ONNX node: /encoder/1/encoder/0/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Add [Add] outputs: [/encoder/1/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Div [Div] inputs: [/encoder/1/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Div for ONNX node: /encoder/1/encoder/0/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Div_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Div [Div] outputs: [/encoder/1/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul [Mul] inputs: [/encoder/1/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Mul for ONNX node: /encoder/1/encoder/0/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul [Mul] outputs: [/encoder/1/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Slice [Slice] inputs: [/encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Slice for ONNX node: /encoder/1/encoder/0/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Slice [Slice] outputs: [/encoder/1/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_5 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul_1 [Mul] inputs: [/encoder/1/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Mul_1 for ONNX node: /encoder/1/encoder/0/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul_1 [Mul] outputs: [/encoder/1/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Slice_1 [Slice] inputs: [/encoder/1/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Slice_1 for ONNX node: /encoder/1/encoder/0/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Slice_1 [Slice] outputs: [/encoder/1/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/1/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul_2 [Mul] inputs: [/encoder/1/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Mul_2 for ONNX node: /encoder/1/encoder/0/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Mul_2 [Mul] outputs: [/encoder/1/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Transpose [Transpose] inputs: [/encoder/1/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Transpose for ONNX node: /encoder/1/encoder/0/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Transpose [Transpose] outputs: [/encoder/1/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Shape_1 [Shape] inputs: [/encoder/1/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Shape_1 for ONNX node: /encoder/1/encoder/0/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Shape_1 [Shape] outputs: [/encoder/1/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Expand for ONNX node: /encoder/1/encoder/0/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Expand [Expand] outputs: [/encoder/1/encoder/0/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Cast [Cast] inputs: [/encoder/1/encoder/0/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Cast for ONNX node: /encoder/1/encoder/0/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Cast [Cast] outputs: [/encoder/1/encoder/0/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Constant_6 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Where [Where] inputs: [/encoder/1/encoder/0/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/1/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/1/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Where for ONNX node: /encoder/1/encoder/0/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Where [Where] outputs: [/encoder/1/encoder/0/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/1/encoder/0/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.1.encoder.layers.0.conv_module2.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/1/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/Transpose_1 for ONNX node: /encoder/1/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Sub for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Exp for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Add [Add] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Add for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Log [Log] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Log for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Log [Log] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Cast for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Equal for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Where [Where] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/1/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Where for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Where [Where] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Mul for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9288 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9288 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9288 for ONNX node: onnx::MatMul_9288 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/1/encoder/0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_6 [Add] inputs: [/encoder/1/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_6 for ONNX node: /encoder/1/encoder/0/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_6_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_6 [Add] outputs: [/encoder/1/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9289 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9289 -> (256, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9289 for ONNX node: onnx::MatMul_9289 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias -> (960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/in_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Sub for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Exp for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Add for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Log for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Cast for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Equal for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Where for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Mul for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9290 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [onnx::MatMul_9290 -> (960, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9290 for ONNX node: onnx::MatMul_9290 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_7 [Add] inputs: [/encoder/1/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/Add_7 for ONNX node: /encoder/1/encoder/0/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/Add_7_output_0 for ONNX tensor: /encoder/1/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/Add_7 [Add] outputs: [/encoder/1/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Sub [Sub] inputs: [/encoder/1/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.0.norm.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.norm.bias for ONNX node: encoder.encoders.1.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Sub for ONNX node: /encoder/1/encoder/0/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Sub [Sub] outputs: [/encoder/1/encoder/0/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Constant [Constant] outputs: [/encoder/1/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Pow [Pow] inputs: [/encoder/1/encoder/0/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Constant_output_0 for ONNX node: /encoder/1/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Pow for ONNX node: /encoder/1/encoder/0/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Pow_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Pow [Pow] outputs: [/encoder/1/encoder/0/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/ReduceMean [ReduceMean] inputs: [/encoder/1/encoder/0/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/ReduceMean for ONNX node: /encoder/1/encoder/0/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/ReduceMean [ReduceMean] outputs: [/encoder/1/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Constant_1 [Constant] outputs: [/encoder/1/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Pow_1 [Pow] inputs: [/encoder/1/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/1/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Constant_1_output_0 for ONNX node: /encoder/1/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Pow_1 for ONNX node: /encoder/1/encoder/0/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Pow_1_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Pow_1 [Pow] outputs: [/encoder/1/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Exp [Exp] inputs: [encoder.encoders.1.encoder.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.norm.log_scale for ONNX node: encoder.encoders.1.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Exp for ONNX node: /encoder/1/encoder/0/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Exp_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Exp [Exp] outputs: [/encoder/1/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Mul [Mul] inputs: [/encoder/1/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/1/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Mul for ONNX node: /encoder/1/encoder/0/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Mul [Mul] outputs: [/encoder/1/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Mul_1 [Mul] inputs: [/encoder/1/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/norm/Mul_1 for ONNX node: /encoder/1/encoder/0/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/norm/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/norm/Mul_1 [Mul] outputs: [/encoder/1/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Sub [Sub] inputs: [/encoder/1/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass/Sub for ONNX node: /encoder/1/encoder/0/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass/Sub_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Sub [Sub] outputs: [/encoder/1/encoder/0/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Mul [Mul] inputs: [/encoder/1/encoder/0/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.0.bypass.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.1.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass/Mul for ONNX node: /encoder/1/encoder/0/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass/Mul_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Mul [Mul] outputs: [/encoder/1/encoder/0/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/0/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Add [Add] inputs: [/encoder/1/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/0/bypass/Add for ONNX node: /encoder/1/encoder/0/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/0/bypass/Add_output_0 for ONNX tensor: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/0/bypass/Add [Add] outputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9291 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9291 -> (256, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9291 for ONNX node: onnx::MatMul_9291 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/in_proj/Add for ONNX node: /encoder/1/encoder/1/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice [Slice] inputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Slice for ONNX node: /encoder/1/encoder/1/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice [Slice] outputs: [/encoder/1/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Slice_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/1/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/1/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Slice_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/1/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1594 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1594 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1594 [Constant] outputs: [onnx::Unsqueeze_2434 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2434 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2434 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1596 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1596 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1596 [Constant] outputs: [onnx::Unsqueeze_2436 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2436 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2436 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1601 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1601 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1601 [Constant] outputs: [onnx::Unsqueeze_2443 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2443 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2443 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1603 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1603 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1603 [Constant] outputs: [onnx::Unsqueeze_2445 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2445 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2445 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1609 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1609 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1609 [Constant] outputs: [onnx::Unsqueeze_2453 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2453 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2453 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1611 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1611 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1611 [Constant] outputs: [onnx::Unsqueeze_2455 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2455 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2455 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Transpose for ONNX node: /encoder/1/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Transpose_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Transpose_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/MatMul for ONNX node: /encoder/1/encoder/1/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9298 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/1/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9298 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9298 for ONNX node: onnx::MatMul_9298 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Mul [Mul] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Mul for ONNX node: /encoder/1/encoder/1/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Mul [Mul] outputs: [/encoder/1/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Sub [Sub] inputs: [/encoder/1/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Sub for ONNX node: /encoder/1/encoder/1/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Sub [Sub] outputs: [/encoder/1/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1628 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1628 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1628 [Constant] outputs: [onnx::Unsqueeze_2476 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2476 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_2476 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Transpose_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/1/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/MatMul_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather_3 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_4 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather_4 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_5 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Gather_5 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/1/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Sub_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast [Cast] inputs: [/encoder/1/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Cast for ONNX node: /encoder/1/encoder/1/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast [Cast] outputs: [/encoder/1/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Range [Range] inputs: [/encoder/1/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Range for ONNX node: /encoder/1/encoder/1/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Range [Range] outputs: [/encoder/1/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Cast_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/1/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Range_1 [Range] inputs: [/encoder/1/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Range_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Range_1 [Range] outputs: [/encoder/1/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Mul_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1659 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1659 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1659 [Constant] outputs: [onnx::Unsqueeze_2509 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2509 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2509 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_4 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1662 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1662 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1662 [Constant] outputs: [onnx::Unsqueeze_2512 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2512 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2512 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_5 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Shape_6 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/1/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/1/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/1/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Expand [Expand] inputs: [/encoder/1/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Expand for ONNX node: /encoder/1/encoder/1/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Expand [Expand] outputs: [/encoder/1/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Tile [Tile] inputs: [/encoder/1/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Tile for ONNX node: /encoder/1/encoder/1/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Tile [Tile] outputs: [/encoder/1/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Add [Add] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Add for ONNX node: /encoder/1/encoder/1/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Add [Add] outputs: [/encoder/1/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1673 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1673 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1673 [Constant] outputs: [onnx::Unsqueeze_2524 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2524 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_2524 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_6 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape_4 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/GatherElements for ONNX node: /encoder/1/encoder/1/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/1/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1678 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1678 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1678 [Constant] outputs: [onnx::Unsqueeze_2529 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2529 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2529 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1680 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1680 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1680 [Constant] outputs: [onnx::Unsqueeze_2531 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2531 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2531 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1682 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1682 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1682 [Constant] outputs: [onnx::Unsqueeze_2533 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2533 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2533 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1684 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1684 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1684 [Constant] outputs: [onnx::Unsqueeze_2535 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2535 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2535 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Concat_7 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/1/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/1/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Reshape_5 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/1/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Add_1 [Add] inputs: [/encoder/1/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Add_1 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Add_1 [Add] outputs: [/encoder/1/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Cast_2 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/1/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Where [Where] inputs: [/encoder/1/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/1/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Where for ONNX node: /encoder/1/encoder/1/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Where [Where] outputs: [/encoder/1/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/1/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn_weights/Softmax for ONNX node: /encoder/1/encoder/1/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/1/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9305 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9305 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9305 for ONNX node: onnx::MatMul_9305 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias -> (576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/in_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Sub for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Exp for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Log for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Cast for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Equal for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Where for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Mul for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9306 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [onnx::MatMul_9306 -> (576, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9306 for ONNX node: onnx::MatMul_9306 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add [Add] inputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add for ONNX node: /encoder/1/encoder/1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add [Add] outputs: [/encoder/1/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant [Constant] outputs: [/encoder/1/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Slice [Slice] inputs: [/encoder/1/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Slice for ONNX node: /encoder/1/encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Slice_output_0 for ONNX tensor: /encoder/1/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Slice [Slice] outputs: [/encoder/1/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9307 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9307 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9307 for ONNX node: onnx::MatMul_9307 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias -> (576)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/in_proj/Add for ONNX node: /encoder/1/encoder/1/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape [Shape] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Add [Add] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Add for ONNX node: /encoder/1/encoder/1/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Add [Add] outputs: [/encoder/1/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Div [Div] inputs: [/encoder/1/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Div for ONNX node: /encoder/1/encoder/1/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Div [Div] outputs: [/encoder/1/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul [Mul] inputs: [/encoder/1/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Mul for ONNX node: /encoder/1/encoder/1/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul [Mul] outputs: [/encoder/1/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice [Slice] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Slice for ONNX node: /encoder/1/encoder/1/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice [Slice] outputs: [/encoder/1/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/1/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Mul_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Slice_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/1/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/1/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Mul_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/1/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/1/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Slice_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/1/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/1/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/1/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 192), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1746 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1746 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1746 [Constant] outputs: [onnx::Unsqueeze_2600 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2600 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2600 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1748 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1748 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1748 [Constant] outputs: [onnx::Unsqueeze_2602 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2602 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2602 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat [Concat] inputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Concat for ONNX node: /encoder/1/encoder/1/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat [Concat] outputs: [/encoder/1/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Reshape for ONNX node: /encoder/1/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/1/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/1/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Mul_3 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape_3 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather_3 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape_4 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather_4 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/1/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Shape_5 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/1/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/1/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Gather_5 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/1/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1763 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1763 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1763 [Constant] outputs: [onnx::Unsqueeze_2618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2618 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1765 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1765 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1765 [Constant] outputs: [onnx::Unsqueeze_2620 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2620 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2620 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1767 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1767 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1767 [Constant] outputs: [onnx::Unsqueeze_2622 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2622 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_2622 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Concat_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/1/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Reshape_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/1/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Transpose for ONNX node: /encoder/1/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/1/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/MatMul for ONNX node: /encoder/1/encoder/1/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/1/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Transpose_1 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1775 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1775 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1775 [Constant] outputs: [onnx::Unsqueeze_2631 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2631 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2631 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1777 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1777 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1777 [Constant] outputs: [onnx::Unsqueeze_2633 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2633 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/1/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2633 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/1/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Concat_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/1/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/1/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Reshape_2 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/1/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/1/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/Mul_4 for ONNX node: /encoder/1/encoder/1/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/1/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9311 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9311 -> (192, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9311 for ONNX node: onnx::MatMul_9311 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/nonlin_attention/out_proj/Add for ONNX node: /encoder/1/encoder/1/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_1 [Add] inputs: [/encoder/1/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_1 for ONNX node: /encoder/1/encoder/1/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_1 [Add] outputs: [/encoder/1/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape [Shape] inputs: [/encoder/1/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Shape for ONNX node: /encoder/1/encoder/1/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape [Shape] outputs: [/encoder/1/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant [Constant] outputs: [/encoder/1/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather [Gather] inputs: [/encoder/1/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Constant_output_0 for ONNX node: /encoder/1/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Gather for ONNX node: /encoder/1/encoder/1/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather [Gather] outputs: [/encoder/1/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Shape_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_1 [Gather] inputs: [/encoder/1/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Gather_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_1 [Gather] outputs: [/encoder/1/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_2 [Shape] inputs: [/encoder/1/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Shape_2 for ONNX node: /encoder/1/encoder/1/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_2 [Shape] outputs: [/encoder/1/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_2 [Gather] inputs: [/encoder/1/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Gather_2 for ONNX node: /encoder/1/encoder/1/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_2 [Gather] outputs: [/encoder/1/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9312 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9312 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9312 for ONNX node: onnx::MatMul_9312 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/1/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/in_proj/Add for ONNX node: /encoder/1/encoder/1/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1797 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1797 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1797 [Constant] outputs: [onnx::Unsqueeze_2656 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2656 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2656 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1799 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1799 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1799 [Constant] outputs: [onnx::Unsqueeze_2658 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2658 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2658 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1801 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1801 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1801 [Constant] outputs: [onnx::Unsqueeze_2660 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2660 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2660 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Concat [Concat] inputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Concat for ONNX node: /encoder/1/encoder/1/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Concat [Concat] outputs: [/encoder/1/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Reshape [Reshape] inputs: [/encoder/1/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/1/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Reshape for ONNX node: /encoder/1/encoder/1/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Reshape [Reshape] outputs: [/encoder/1/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Transpose [Transpose] inputs: [/encoder/1/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Transpose for ONNX node: /encoder/1/encoder/1/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Transpose [Transpose] outputs: [/encoder/1/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_3 [Shape] inputs: [/encoder/1/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Shape_3 for ONNX node: /encoder/1/encoder/1/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Shape_3 [Shape] outputs: [/encoder/1/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_3 [Gather] inputs: [/encoder/1/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Gather_3 for ONNX node: /encoder/1/encoder/1/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Gather_3 [Gather] outputs: [/encoder/1/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/MatMul [MatMul] inputs: [/encoder/1/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/MatMul for ONNX node: /encoder/1/encoder/1/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Transpose_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Mul [Mul] inputs: [/encoder/1/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Mul for ONNX node: /encoder/1/encoder/1/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Mul [Mul] outputs: [/encoder/1/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1813 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1813 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1813 [Constant] outputs: [onnx::Unsqueeze_2673 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2673 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2673 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1815 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1815 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1815 [Constant] outputs: [onnx::Unsqueeze_2675 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2675 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2675 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1817 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1817 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1817 [Constant] outputs: [onnx::Unsqueeze_2677 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2677 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_2677 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/1/encoder/1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Concat_1 [Concat] inputs: [/encoder/1/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Concat_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Concat_1 [Concat] outputs: [/encoder/1/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/1/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/Reshape_1 for ONNX node: /encoder/1/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9314 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9314 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9314 for ONNX node: onnx::MatMul_9314 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn1/out_proj/Add for ONNX node: /encoder/1/encoder/1/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn1/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_2 [Add] inputs: [/encoder/1/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_2 for ONNX node: /encoder/1/encoder/1/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_2_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_2 [Add] outputs: [/encoder/1/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9315 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9315 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9315 for ONNX node: onnx::MatMul_9315 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias -> (512)[FLOAT]], [/encoder/1/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/in_proj/Add for ONNX node: /encoder/1/encoder/1/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Shape [Shape] inputs: [/encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Shape for ONNX node: /encoder/1/encoder/1/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Shape [Shape] outputs: [/encoder/1/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Gather [Gather] inputs: [/encoder/1/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Gather for ONNX node: /encoder/1/encoder/1/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Gather [Gather] outputs: [/encoder/1/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Add [Add] inputs: [/encoder/1/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Add for ONNX node: /encoder/1/encoder/1/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Add [Add] outputs: [/encoder/1/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Div [Div] inputs: [/encoder/1/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Div for ONNX node: /encoder/1/encoder/1/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Div_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Div [Div] outputs: [/encoder/1/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul [Mul] inputs: [/encoder/1/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Mul for ONNX node: /encoder/1/encoder/1/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul [Mul] outputs: [/encoder/1/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Slice [Slice] inputs: [/encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Slice for ONNX node: /encoder/1/encoder/1/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Slice [Slice] outputs: [/encoder/1/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_5 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul_1 [Mul] inputs: [/encoder/1/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Mul_1 for ONNX node: /encoder/1/encoder/1/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul_1 [Mul] outputs: [/encoder/1/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Slice_1 [Slice] inputs: [/encoder/1/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Slice_1 for ONNX node: /encoder/1/encoder/1/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Slice_1 [Slice] outputs: [/encoder/1/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/1/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul_2 [Mul] inputs: [/encoder/1/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Mul_2 for ONNX node: /encoder/1/encoder/1/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Mul_2 [Mul] outputs: [/encoder/1/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Transpose [Transpose] inputs: [/encoder/1/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Transpose for ONNX node: /encoder/1/encoder/1/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Transpose [Transpose] outputs: [/encoder/1/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Shape_1 for ONNX node: /encoder/1/encoder/1/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Expand for ONNX node: /encoder/1/encoder/1/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Expand [Expand] outputs: [/encoder/1/encoder/1/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Cast [Cast] inputs: [/encoder/1/encoder/1/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Cast for ONNX node: /encoder/1/encoder/1/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Cast [Cast] outputs: [/encoder/1/encoder/1/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Constant_6 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Where [Where] inputs: [/encoder/1/encoder/1/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/1/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/1/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Where for ONNX node: /encoder/1/encoder/1/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Where [Where] outputs: [/encoder/1/encoder/1/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/1/encoder/1/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.1.encoder.layers.1.conv_module1.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/1/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/Transpose_1 for ONNX node: /encoder/1/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Sub for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Exp for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Add [Add] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Add for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Log [Log] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Log for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Log [Log] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Cast for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Equal for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Where [Where] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/1/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Where for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Where [Where] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Mul for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9316 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9316 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9316 for ONNX node: onnx::MatMul_9316 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/1/encoder/1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_3 [Add] inputs: [/encoder/1/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_3 for ONNX node: /encoder/1/encoder/1/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_3_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_3 [Add] outputs: [/encoder/1/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9317 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9317 -> (256, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9317 for ONNX node: onnx::MatMul_9317 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias -> (768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/in_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Sub for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Exp for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Log for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Cast for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Equal for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Where for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Mul for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9318 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9318 -> (768, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9318 for ONNX node: onnx::MatMul_9318 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_4 [Add] inputs: [/encoder/1/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_4 for ONNX node: /encoder/1/encoder/1/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_4_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_4 [Add] outputs: [/encoder/1/encoder/1/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Sub [Sub] inputs: [/encoder/1/encoder/1/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass_mid/Sub for ONNX node: /encoder/1/encoder/1/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Sub [Sub] outputs: [/encoder/1/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Mul [Mul] inputs: [/encoder/1/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass_mid/Mul for ONNX node: /encoder/1/encoder/1/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Mul [Mul] outputs: [/encoder/1/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Add [Add] inputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass_mid/Add for ONNX node: /encoder/1/encoder/1/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass_mid/Add [Add] outputs: [/encoder/1/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape [Shape] inputs: [/encoder/1/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Shape for ONNX node: /encoder/1/encoder/1/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape [Shape] outputs: [/encoder/1/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant [Constant] outputs: [/encoder/1/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather [Gather] inputs: [/encoder/1/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Constant_output_0 for ONNX node: /encoder/1/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Gather for ONNX node: /encoder/1/encoder/1/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather [Gather] outputs: [/encoder/1/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Shape_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather_1 [Gather] inputs: [/encoder/1/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Gather_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather_1 [Gather] outputs: [/encoder/1/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9319 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9319 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9319 for ONNX node: onnx::MatMul_9319 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/1/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/in_proj/Add for ONNX node: /encoder/1/encoder/1/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1899 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1899 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1899 [Constant] outputs: [onnx::Unsqueeze_2765 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2765 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2765 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1901 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1901 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1901 [Constant] outputs: [onnx::Unsqueeze_2767 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2767 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2767 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1903 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1903 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1903 [Constant] outputs: [onnx::Unsqueeze_2769 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2769 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2769 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Concat [Concat] inputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Concat for ONNX node: /encoder/1/encoder/1/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Concat [Concat] outputs: [/encoder/1/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Reshape [Reshape] inputs: [/encoder/1/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/1/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Reshape for ONNX node: /encoder/1/encoder/1/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Reshape [Reshape] outputs: [/encoder/1/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Transpose [Transpose] inputs: [/encoder/1/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Transpose for ONNX node: /encoder/1/encoder/1/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Transpose [Transpose] outputs: [/encoder/1/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape_2 [Shape] inputs: [/encoder/1/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Shape_2 for ONNX node: /encoder/1/encoder/1/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Shape_2 [Shape] outputs: [/encoder/1/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather_2 [Gather] inputs: [/encoder/1/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/1/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Gather_2 for ONNX node: /encoder/1/encoder/1/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Gather_2 [Gather] outputs: [/encoder/1/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/MatMul [MatMul] inputs: [/encoder/1/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/1/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/MatMul for ONNX node: /encoder/1/encoder/1/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Transpose_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Mul [Mul] inputs: [/encoder/1/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/1/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Mul for ONNX node: /encoder/1/encoder/1/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Mul [Mul] outputs: [/encoder/1/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1915 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1915 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1915 [Constant] outputs: [onnx::Unsqueeze_2782 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2782 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_2782 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1917 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1917 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1917 [Constant] outputs: [onnx::Unsqueeze_2784 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2784 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2784 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_1919 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_1919 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_1919 [Constant] outputs: [onnx::Unsqueeze_2786 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2786 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_2786 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/1/encoder/1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Concat_1 [Concat] inputs: [/encoder/1/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Concat_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Concat_1 [Concat] outputs: [/encoder/1/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/1/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/1/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/Reshape_1 for ONNX node: /encoder/1/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/1/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9321 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9321 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9321 for ONNX node: onnx::MatMul_9321 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/self_attn2/out_proj/Add for ONNX node: /encoder/1/encoder/1/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/self_attn2/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_5 [Add] inputs: [/encoder/1/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_5 for ONNX node: /encoder/1/encoder/1/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_5_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_5 [Add] outputs: [/encoder/1/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9322 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9322 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9322 for ONNX node: onnx::MatMul_9322 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias -> (512)[FLOAT]], [/encoder/1/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/in_proj/Add for ONNX node: /encoder/1/encoder/1/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Shape [Shape] inputs: [/encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Shape for ONNX node: /encoder/1/encoder/1/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Shape [Shape] outputs: [/encoder/1/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Gather [Gather] inputs: [/encoder/1/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Gather for ONNX node: /encoder/1/encoder/1/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Gather [Gather] outputs: [/encoder/1/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Add [Add] inputs: [/encoder/1/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Add for ONNX node: /encoder/1/encoder/1/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Add [Add] outputs: [/encoder/1/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Div [Div] inputs: [/encoder/1/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Div for ONNX node: /encoder/1/encoder/1/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Div_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Div [Div] outputs: [/encoder/1/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul [Mul] inputs: [/encoder/1/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Mul for ONNX node: /encoder/1/encoder/1/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul [Mul] outputs: [/encoder/1/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Slice [Slice] inputs: [/encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Slice for ONNX node: /encoder/1/encoder/1/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Slice [Slice] outputs: [/encoder/1/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_5 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul_1 [Mul] inputs: [/encoder/1/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Mul_1 for ONNX node: /encoder/1/encoder/1/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul_1 [Mul] outputs: [/encoder/1/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Slice_1 [Slice] inputs: [/encoder/1/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/1/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/1/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Slice_1 for ONNX node: /encoder/1/encoder/1/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Slice_1 [Slice] outputs: [/encoder/1/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/1/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul_2 [Mul] inputs: [/encoder/1/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Mul_2 for ONNX node: /encoder/1/encoder/1/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Mul_2 [Mul] outputs: [/encoder/1/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Transpose [Transpose] inputs: [/encoder/1/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Transpose for ONNX node: /encoder/1/encoder/1/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Transpose [Transpose] outputs: [/encoder/1/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Shape_1 for ONNX node: /encoder/1/encoder/1/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Shape_1 [Shape] outputs: [/encoder/1/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/1/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Expand for ONNX node: /encoder/1/encoder/1/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Expand [Expand] outputs: [/encoder/1/encoder/1/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Cast [Cast] inputs: [/encoder/1/encoder/1/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Cast for ONNX node: /encoder/1/encoder/1/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Cast [Cast] outputs: [/encoder/1/encoder/1/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Constant_6 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Where [Where] inputs: [/encoder/1/encoder/1/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/1/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/1/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Where for ONNX node: /encoder/1/encoder/1/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Where [Where] outputs: [/encoder/1/encoder/1/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/1/encoder/1/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.1.encoder.layers.1.conv_module2.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/1/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/1/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/Transpose_1 for ONNX node: /encoder/1/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/1/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Sub for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Exp for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Add [Add] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Add for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Log [Log] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Log for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Log [Log] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Cast for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Equal for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Where [Where] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/1/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Where for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Where [Where] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Mul for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9323 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9323 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9323 for ONNX node: onnx::MatMul_9323 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/1/encoder/1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_6 [Add] inputs: [/encoder/1/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_6 for ONNX node: /encoder/1/encoder/1/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_6_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_6 [Add] outputs: [/encoder/1/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9324 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9324 -> (256, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9324 for ONNX node: onnx::MatMul_9324 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias -> (960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/in_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Sub for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Exp for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Add for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Log for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Cast for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Equal for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Where for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/1/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Mul for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9325 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [onnx::MatMul_9325 -> (960, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9325 for ONNX node: onnx::MatMul_9325 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias -> (256)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/1/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_7 [Add] inputs: [/encoder/1/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/Add_7 for ONNX node: /encoder/1/encoder/1/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/Add_7_output_0 for ONNX tensor: /encoder/1/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/Add_7 [Add] outputs: [/encoder/1/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Sub [Sub] inputs: [/encoder/1/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.1.norm.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.norm.bias for ONNX node: encoder.encoders.1.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Sub for ONNX node: /encoder/1/encoder/1/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Sub [Sub] outputs: [/encoder/1/encoder/1/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Constant [Constant] outputs: [/encoder/1/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Pow [Pow] inputs: [/encoder/1/encoder/1/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Constant_output_0 for ONNX node: /encoder/1/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Pow for ONNX node: /encoder/1/encoder/1/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Pow_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Pow [Pow] outputs: [/encoder/1/encoder/1/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/ReduceMean [ReduceMean] inputs: [/encoder/1/encoder/1/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/ReduceMean for ONNX node: /encoder/1/encoder/1/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/ReduceMean [ReduceMean] outputs: [/encoder/1/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Constant_1 [Constant] outputs: [/encoder/1/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Pow_1 [Pow] inputs: [/encoder/1/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/1/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Constant_1_output_0 for ONNX node: /encoder/1/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Pow_1 for ONNX node: /encoder/1/encoder/1/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Pow_1_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Pow_1 [Pow] outputs: [/encoder/1/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Exp [Exp] inputs: [encoder.encoders.1.encoder.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.norm.log_scale for ONNX node: encoder.encoders.1.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Exp for ONNX node: /encoder/1/encoder/1/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Exp_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Exp [Exp] outputs: [/encoder/1/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Mul [Mul] inputs: [/encoder/1/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/1/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Mul for ONNX node: /encoder/1/encoder/1/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Mul [Mul] outputs: [/encoder/1/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Mul_1 [Mul] inputs: [/encoder/1/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/norm/Mul_1 for ONNX node: /encoder/1/encoder/1/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/norm/Mul_1_output_0 for ONNX tensor: /encoder/1/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/norm/Mul_1 [Mul] outputs: [/encoder/1/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Sub [Sub] inputs: [/encoder/1/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass/Sub for ONNX node: /encoder/1/encoder/1/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass/Sub_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Sub [Sub] outputs: [/encoder/1/encoder/1/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Mul [Mul] inputs: [/encoder/1/encoder/1/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.encoder.layers.1.bypass.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.encoder.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.1.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass/Mul for ONNX node: /encoder/1/encoder/1/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass/Mul_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Mul [Mul] outputs: [/encoder/1/encoder/1/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/encoder/1/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Add [Add] inputs: [/encoder/1/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/encoder/1/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/encoder/1/bypass/Add for ONNX node: /encoder/1/encoder/1/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/encoder/1/bypass/Add_output_0 for ONNX tensor: /encoder/1/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/encoder/1/bypass/Add [Add] outputs: [/encoder/1/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape [Shape] inputs: [/encoder/1/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Shape for ONNX node: /encoder/1/upsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Shape_output_0 for ONNX tensor: /encoder/1/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape [Shape] outputs: [/encoder/1/upsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant [Constant] outputs: [/encoder/1/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather [Gather] inputs: [/encoder/1/upsample/Shape_output_0 -> (3)[INT32]], [/encoder/1/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_output_0 for ONNX node: /encoder/1/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Gather for ONNX node: /encoder/1/upsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Gather_output_0 for ONNX tensor: /encoder/1/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather [Gather] outputs: [/encoder/1/upsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_1 [Shape] inputs: [/encoder/1/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Shape_1 for ONNX node: /encoder/1/upsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Shape_1_output_0 for ONNX tensor: /encoder/1/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_1 [Shape] outputs: [/encoder/1/upsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_1 [Constant] outputs: [/encoder/1/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather_1 [Gather] inputs: [/encoder/1/upsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/1/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_1_output_0 for ONNX node: /encoder/1/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Gather_1 for ONNX node: /encoder/1/upsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Gather_1_output_0 for ONNX tensor: /encoder/1/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather_1 [Gather] outputs: [/encoder/1/upsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_2 [Shape] inputs: [/encoder/1/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Shape_2 for ONNX node: /encoder/1/upsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Shape_2_output_0 for ONNX tensor: /encoder/1/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_2 [Shape] outputs: [/encoder/1/upsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_2 [Constant] outputs: [/encoder/1/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather_2 [Gather] inputs: [/encoder/1/upsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/1/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_2_output_0 for ONNX node: /encoder/1/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Gather_2 for ONNX node: /encoder/1/upsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Gather_2_output_0 for ONNX tensor: /encoder/1/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Gather_2 [Gather] outputs: [/encoder/1/upsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_3 [Constant] outputs: [/encoder/1/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze [Unsqueeze] inputs: [/encoder/1/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 256), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze for ONNX node: /encoder/1/upsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_4 [Constant] outputs: [/encoder/1/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/1/upsample/Gather_output_0 -> ()[INT32]], [/encoder/1/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_1 for ONNX node: /encoder/1/upsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_5 [Constant] outputs: [/encoder/1/upsample/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_6 [Constant] outputs: [/encoder/1/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/1/upsample/Gather_1_output_0 -> ()[INT32]], [/encoder/1/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_2 for ONNX node: /encoder/1/upsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_7 [Constant] outputs: [/encoder/1/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/1/upsample/Gather_2_output_0 -> ()[INT32]], [/encoder/1/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_3 for ONNX node: /encoder/1/upsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Concat [Concat] inputs: [/encoder/1/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/1/upsample/Constant_5_output_0 -> (1)[INT32]], [/encoder/1/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/1/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_5_output_0 for ONNX node: /encoder/1/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Concat for ONNX node: /encoder/1/upsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Concat_output_0 for ONNX tensor: /encoder/1/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Concat [Concat] outputs: [/encoder/1/upsample/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_8 [Constant] outputs: [/encoder/1/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Reshape [Reshape] inputs: [/encoder/1/upsample/Concat_output_0 -> (4)[INT32]], [/encoder/1/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Reshape for ONNX node: /encoder/1/upsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Reshape_output_0 for ONNX tensor: /encoder/1/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Reshape [Reshape] outputs: [/encoder/1/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_3 [Shape] inputs: [/encoder/1/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Shape_3 for ONNX node: /encoder/1/upsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Shape_3_output_0 for ONNX tensor: /encoder/1/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Shape_3 [Shape] outputs: [/encoder/1/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/1/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/1/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/1/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_9 [Constant] outputs: [/encoder/1/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Mul [Mul] inputs: [/encoder/1/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/1/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_9_output_0 for ONNX node: /encoder/1/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Mul for ONNX node: /encoder/1/upsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Mul_output_0 for ONNX tensor: /encoder/1/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Mul [Mul] outputs: [/encoder/1/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Equal [Equal] inputs: [/encoder/1/upsample/Reshape_output_0 -> (4)[INT32]], [/encoder/1/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Equal for ONNX node: /encoder/1/upsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Equal_output_0 for ONNX tensor: /encoder/1/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Equal [Equal] outputs: [/encoder/1/upsample/Equal_output_0 -> (4)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Where [Where] inputs: [/encoder/1/upsample/Equal_output_0 -> (4)[BOOL]], [/encoder/1/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/1/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Where for ONNX node: /encoder/1/upsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Where_output_0 for ONNX tensor: /encoder/1/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Where [Where] outputs: [/encoder/1/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Expand [Expand] inputs: [/encoder/1/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 256)[FLOAT]], [/encoder/1/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Expand for ONNX node: /encoder/1/upsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Expand_output_0 for ONNX tensor: /encoder/1/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Expand [Expand] outputs: [/encoder/1/upsample/Expand_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Constant_10 [Constant] outputs: [/encoder/1/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Mul_1 [Mul] inputs: [/encoder/1/upsample/Gather_output_0 -> ()[INT32]], [/encoder/1/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Constant_10_output_0 for ONNX node: /encoder/1/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Mul_1 for ONNX node: /encoder/1/upsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Mul_1_output_0 for ONNX tensor: /encoder/1/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Mul_1 [Mul] outputs: [/encoder/1/upsample/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2032 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2032 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2032 [Constant] outputs: [onnx::Unsqueeze_2905 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2905 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/1/upsample/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2905 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_4 for ONNX node: /encoder/1/upsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2034 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2034 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2034 [Constant] outputs: [onnx::Unsqueeze_2907 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2907 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/1/upsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2907 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_5 for ONNX node: /encoder/1/upsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2036 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2036 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2036 [Constant] outputs: [onnx::Unsqueeze_2909 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2909 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/1/upsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_2909 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Unsqueeze_6 for ONNX node: /encoder/1/upsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/1/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/1/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Concat_1 [Concat] inputs: [/encoder/1/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/1/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/1/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Concat_1 for ONNX node: /encoder/1/upsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Concat_1_output_0 for ONNX tensor: /encoder/1/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Concat_1 [Concat] outputs: [/encoder/1/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/upsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Reshape_1 [Reshape] inputs: [/encoder/1/upsample/Expand_output_0 -> (-1, 2, -1, 256)[FLOAT]], [/encoder/1/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/upsample/Reshape_1 for ONNX node: /encoder/1/upsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/upsample/Reshape_1_output_0 for ONNX tensor: /encoder/1/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/upsample/Reshape_1 [Reshape] outputs: [/encoder/1/upsample/Reshape_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant [Constant] outputs: [/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_1 [Constant] outputs: [/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Unsqueeze [Unsqueeze] inputs: [/encoder/1/downsample/Gather_output_0 -> ()[INT32]], [/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/Unsqueeze for ONNX node: /encoder/1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/Unsqueeze_output_0 for ONNX tensor: /encoder/1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Unsqueeze [Unsqueeze] outputs: [/encoder/1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_2 [Constant] outputs: [/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Constant_3 [Constant] outputs: [/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Slice [Slice] inputs: [/encoder/1/upsample/Reshape_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/Slice for ONNX node: /encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/Slice_output_0 for ONNX tensor: /encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/Slice [Slice] outputs: [/encoder/1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/out_combiner/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Sub [Sub] inputs: [/encoder/1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/out_combiner/Sub for ONNX node: /encoder/1/out_combiner/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/out_combiner/Sub_output_0 for ONNX tensor: /encoder/1/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Sub [Sub] outputs: [/encoder/1/out_combiner/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/out_combiner/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.1.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Mul [Mul] inputs: [/encoder/1/out_combiner/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.out_combiner.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.1.out_combiner.bypass_scale for ONNX node: encoder.encoders.1.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/out_combiner/Mul for ONNX node: /encoder/1/out_combiner/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/out_combiner/Mul_output_0 for ONNX tensor: /encoder/1/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Mul [Mul] outputs: [/encoder/1/out_combiner/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/1/out_combiner/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Add [Add] inputs: [/encoder/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/1/out_combiner/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/1/out_combiner/Add for ONNX node: /encoder/1/out_combiner/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/1/out_combiner/Add_output_0 for ONNX tensor: /encoder/1/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/1/out_combiner/Add [Add] outputs: [/encoder/1/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_3 [Shape] inputs: [/encoder/1/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_3 for ONNX node: /encoder/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_3_output_0 for ONNX tensor: /encoder/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_3 [Shape] outputs: [/encoder/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_12 [Constant] outputs: [/encoder/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_3 [Gather] inputs: [/encoder/Shape_3_output_0 -> (3)[INT32]], [/encoder/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_12_output_0 for ONNX node: /encoder/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_3 for ONNX node: /encoder/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_3_output_0 for ONNX tensor: /encoder/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_3 [Gather] outputs: [/encoder/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_4 [Shape] inputs: [/encoder/1/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_4 for ONNX node: /encoder/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_4_output_0 for ONNX tensor: /encoder/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_4 [Shape] outputs: [/encoder/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_13 [Constant] outputs: [/encoder/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_4 [Gather] inputs: [/encoder/Shape_4_output_0 -> (3)[INT32]], [/encoder/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_13_output_0 for ONNX node: /encoder/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_4 for ONNX node: /encoder/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_4_output_0 for ONNX tensor: /encoder/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_4 [Gather] outputs: [/encoder/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_5 [Shape] inputs: [/encoder/1/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_5 for ONNX node: /encoder/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_5_output_0 for ONNX tensor: /encoder/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_5 [Shape] outputs: [/encoder/Shape_5_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_14 [Constant] outputs: [/encoder/Constant_14_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_5 [Gather] inputs: [/encoder/Shape_5_output_0 -> (3)[INT32]], [/encoder/Constant_14_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_14_output_0 for ONNX node: /encoder/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_5 for ONNX node: /encoder/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_5_output_0 for ONNX tensor: /encoder/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_5 [Gather] outputs: [/encoder/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_15 [Constant] outputs: [/encoder/Constant_15_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Sub_1 [Sub] inputs: [/encoder/Constant_15_output_0 -> ()[INT32]], [/encoder/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_15_output_0 for ONNX node: /encoder/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Sub_1 for ONNX node: /encoder/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Sub_1_output_0 for ONNX tensor: /encoder/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Sub_1 [Sub] outputs: [/encoder/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2060 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2060 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2060 [Constant] outputs: [onnx::Unsqueeze_2935 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2935 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_2935 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_3 for ONNX node: /encoder/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_3_output_0 for ONNX tensor: /encoder/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2062 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2062 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2062 [Constant] outputs: [onnx::Unsqueeze_2937 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2937 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_2937 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_4 for ONNX node: /encoder/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_4_output_0 for ONNX tensor: /encoder/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2064 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2064 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2064 [Constant] outputs: [onnx::Unsqueeze_2939 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2939 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/Sub_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2939 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_5 for ONNX node: /encoder/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_5_output_0 for ONNX tensor: /encoder/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_2 [Concat] inputs: [/encoder/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Concat_2 for ONNX node: /encoder/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Concat_2_output_0 for ONNX tensor: /encoder/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_2 [Concat] outputs: [/encoder/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/ConstantOfShape_1 [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/ConstantOfShape_1 [ConstantOfShape] inputs: [/encoder/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/ConstantOfShape_1_output_0 for ONNX tensor: /encoder/ConstantOfShape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/ConstantOfShape_1 [ConstantOfShape] outputs: [/encoder/ConstantOfShape_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/ConstantOfShape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_3 [Concat] inputs: [/encoder/1/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/ConstantOfShape_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Concat_3 for ONNX node: /encoder/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Concat_3_output_0 for ONNX tensor: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_3 [Concat] outputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_16 [Constant] outputs: [/encoder/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_17 [Constant] outputs: [/encoder/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_18 [Constant] outputs: [/encoder/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_19 [Constant] outputs: [/encoder/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /GreaterOrEqual_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_2 [Slice] inputs: [/GreaterOrEqual_output_0 -> (-1, -1)[BOOL]], [/encoder/Constant_17_output_0 -> (1)[INT32]], [/encoder/Constant_18_output_0 -> (1)[INT32]], [/encoder/Constant_16_output_0 -> (1)[INT32]], [/encoder/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_2 for ONNX node: /encoder/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_2_output_0 for ONNX tensor: /encoder/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_2 [Slice] outputs: [/encoder/Slice_2_output_0 -> (-1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape [Shape] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Shape for ONNX node: /encoder/2/downsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Shape_output_0 for ONNX tensor: /encoder/2/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape [Shape] outputs: [/encoder/2/downsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant [Constant] outputs: [/encoder/2/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather [Gather] inputs: [/encoder/2/downsample/Shape_output_0 -> (3)[INT32]], [/encoder/2/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_output_0 for ONNX node: /encoder/2/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Gather for ONNX node: /encoder/2/downsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Gather_output_0 for ONNX tensor: /encoder/2/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather [Gather] outputs: [/encoder/2/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_1 [Shape] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Shape_1 for ONNX node: /encoder/2/downsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Shape_1_output_0 for ONNX tensor: /encoder/2/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_1 [Shape] outputs: [/encoder/2/downsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_1 [Constant] outputs: [/encoder/2/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather_1 [Gather] inputs: [/encoder/2/downsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_1_output_0 for ONNX node: /encoder/2/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Gather_1 for ONNX node: /encoder/2/downsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Gather_1_output_0 for ONNX tensor: /encoder/2/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather_1 [Gather] outputs: [/encoder/2/downsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_2 [Shape] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Shape_2 for ONNX node: /encoder/2/downsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Shape_2_output_0 for ONNX tensor: /encoder/2/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_2 [Shape] outputs: [/encoder/2/downsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_2 [Constant] outputs: [/encoder/2/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather_2 [Gather] inputs: [/encoder/2/downsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/2/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_2_output_0 for ONNX node: /encoder/2/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Gather_2 for ONNX node: /encoder/2/downsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Gather_2_output_0 for ONNX tensor: /encoder/2/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Gather_2 [Gather] outputs: [/encoder/2/downsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_3 [Constant] outputs: [/encoder/2/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Add [Add] inputs: [/encoder/2/downsample/Gather_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_3_output_0 for ONNX node: /encoder/2/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Add for ONNX node: /encoder/2/downsample/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Add_output_0 for ONNX tensor: /encoder/2/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Add [Add] outputs: [/encoder/2/downsample/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_4 [Constant] outputs: [/encoder/2/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub [Sub] inputs: [/encoder/2/downsample/Add_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_4_output_0 for ONNX node: /encoder/2/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Sub for ONNX node: /encoder/2/downsample/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Sub_output_0 for ONNX tensor: /encoder/2/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub [Sub] outputs: [/encoder/2/downsample/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_5 [Constant] outputs: [/encoder/2/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Div [Div] inputs: [/encoder/2/downsample/Sub_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_5_output_0 for ONNX node: /encoder/2/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Div for ONNX node: /encoder/2/downsample/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Div_output_0 for ONNX tensor: /encoder/2/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Div [Div] outputs: [/encoder/2/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Cast [Cast] inputs: [/encoder/2/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Cast for ONNX node: /encoder/2/downsample/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Cast_output_0 for ONNX tensor: /encoder/2/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Cast [Cast] outputs: [/encoder/2/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Cast_1 [Cast] inputs: [/encoder/2/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Cast_1 for ONNX node: /encoder/2/downsample/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Cast_1_output_0 for ONNX tensor: /encoder/2/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Cast_1 [Cast] outputs: [/encoder/2/downsample/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_6 [Constant] outputs: [/encoder/2/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul [Mul] inputs: [/encoder/2/downsample/Cast_1_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_6_output_0 for ONNX node: /encoder/2/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Mul for ONNX node: /encoder/2/downsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Mul_output_0 for ONNX tensor: /encoder/2/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul [Mul] outputs: [/encoder/2/downsample/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub_1 [Sub] inputs: [/encoder/2/downsample/Mul_output_0 -> ()[INT32]], [/encoder/2/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Sub_1 for ONNX node: /encoder/2/downsample/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Sub_1_output_0 for ONNX tensor: /encoder/2/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub_1 [Sub] outputs: [/encoder/2/downsample/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_7 [Constant] outputs: [/encoder/2/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub_2 [Sub] inputs: [/encoder/2/downsample/Gather_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_7_output_0 for ONNX node: /encoder/2/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Sub_2 for ONNX node: /encoder/2/downsample/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Sub_2_output_0 for ONNX tensor: /encoder/2/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Sub_2 [Sub] outputs: [/encoder/2/downsample/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_8 [Constant] outputs: [/encoder/2/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze [Unsqueeze] inputs: [/encoder/2/downsample/Sub_2_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze for ONNX node: /encoder/2/downsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_9 [Constant] outputs: [/encoder/2/downsample/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_10 [Constant] outputs: [/encoder/2/downsample/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_11 [Constant] outputs: [/encoder/2/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Slice [Slice] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/downsample/Constant_9_output_0 -> (1)[INT32]], [/encoder/2/downsample/Constant_10_output_0 -> (1)[INT32]], [/encoder/2/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Slice for ONNX node: /encoder/2/downsample/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Slice_output_0 for ONNX tensor: /encoder/2/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Slice [Slice] outputs: [/encoder/2/downsample/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_12 [Constant] outputs: [/encoder/2/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/downsample/Sub_1_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_1 for ONNX node: /encoder/2/downsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_13 [Constant] outputs: [/encoder/2/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/downsample/Gather_1_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_2 for ONNX node: /encoder/2/downsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_14 [Constant] outputs: [/encoder/2/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/downsample/Gather_2_output_0 -> ()[INT32]], [/encoder/2/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_3 for ONNX node: /encoder/2/downsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat [Concat] inputs: [/encoder/2/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Concat for ONNX node: /encoder/2/downsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Concat_output_0 for ONNX tensor: /encoder/2/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat [Concat] outputs: [/encoder/2/downsample/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_15 [Constant] outputs: [/encoder/2/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Reshape [Reshape] inputs: [/encoder/2/downsample/Concat_output_0 -> (3)[INT32]], [/encoder/2/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Reshape for ONNX node: /encoder/2/downsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Reshape_output_0 for ONNX tensor: /encoder/2/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Reshape [Reshape] outputs: [/encoder/2/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_3 [Shape] inputs: [/encoder/2/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Shape_3 for ONNX node: /encoder/2/downsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Shape_3_output_0 for ONNX tensor: /encoder/2/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Shape_3 [Shape] outputs: [/encoder/2/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/2/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/2/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/2/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_16 [Constant] outputs: [/encoder/2/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul_1 [Mul] inputs: [/encoder/2/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/2/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_16_output_0 for ONNX node: /encoder/2/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Mul_1 for ONNX node: /encoder/2/downsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Mul_1_output_0 for ONNX tensor: /encoder/2/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul_1 [Mul] outputs: [/encoder/2/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Equal [Equal] inputs: [/encoder/2/downsample/Reshape_output_0 -> (3)[INT32]], [/encoder/2/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Equal for ONNX node: /encoder/2/downsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Equal_output_0 for ONNX tensor: /encoder/2/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Equal [Equal] outputs: [/encoder/2/downsample/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Where [Where] inputs: [/encoder/2/downsample/Equal_output_0 -> (3)[BOOL]], [/encoder/2/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/2/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Where for ONNX node: /encoder/2/downsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Where_output_0 for ONNX tensor: /encoder/2/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Where [Where] outputs: [/encoder/2/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Expand [Expand] inputs: [/encoder/2/downsample/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Expand for ONNX node: /encoder/2/downsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Expand_output_0 for ONNX tensor: /encoder/2/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Expand [Expand] outputs: [/encoder/2/downsample/Expand_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat_1 [Concat] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/Expand_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Concat_1 for ONNX node: /encoder/2/downsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Concat_1_output_0 for ONNX tensor: /encoder/2/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat_1 [Concat] outputs: [/encoder/2/downsample/Concat_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2119 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2119 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2119 [Constant] outputs: [onnx::Unsqueeze_2996 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_2996 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/downsample/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_2996 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_4 for ONNX node: /encoder/2/downsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Constant_17 [Constant] outputs: [/encoder/2/downsample/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2122 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2122 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2122 [Constant] outputs: [onnx::Unsqueeze_3000 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3000 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/downsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3000 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_5 for ONNX node: /encoder/2/downsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2124 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2124 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2124 [Constant] outputs: [onnx::Unsqueeze_3002 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3002 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/downsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3002 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Unsqueeze_6 for ONNX node: /encoder/2/downsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat_2 [Concat] inputs: [/encoder/2/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/downsample/Constant_17_output_0 -> (1)[INT32]], [/encoder/2/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Constant_17_output_0 for ONNX node: /encoder/2/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Concat_2 for ONNX node: /encoder/2/downsample/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Concat_2_output_0 for ONNX tensor: /encoder/2/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Concat_2 [Concat] outputs: [/encoder/2/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Reshape_1 [Reshape] inputs: [/encoder/2/downsample/Concat_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Reshape_1 for ONNX node: /encoder/2/downsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Reshape_1_output_0 for ONNX tensor: /encoder/2/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Reshape_1 [Reshape] outputs: [/encoder/2/downsample/Reshape_1_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Softmax_9333 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Softmax [Softmax] inputs: [onnx::Softmax_9333 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::Softmax_9333 for ONNX node: onnx::Softmax_9333 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Softmax for ONNX node: /encoder/2/downsample/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Softmax_output_0 for ONNX tensor: /encoder/2/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Softmax [Softmax] outputs: [/encoder/2/downsample/Softmax_output_0 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul_2 [Mul] inputs: [/encoder/2/downsample/Reshape_1_output_0 -> (-1, 4, -1, 384)[FLOAT]], [/encoder/2/downsample/Softmax_output_0 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/Mul_2 for ONNX node: /encoder/2/downsample/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/Mul_2_output_0 for ONNX tensor: /encoder/2/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/Mul_2 [Mul] outputs: [/encoder/2/downsample/Mul_2_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/downsample/ReduceSum [ReduceSum] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/ReduceSum [ReduceSum] inputs: [/encoder/2/downsample/Mul_2_output_0 -> (-1, 4, -1, 384)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/downsample/ReduceSum for ONNX node: /encoder/2/downsample/ReduceSum [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/downsample/ReduceSum_output_0 for ONNX tensor: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/downsample/ReduceSum [ReduceSum] outputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Shape [Shape] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Shape for ONNX node: /encoder/2/encoder/encoder_pos/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Shape [Shape] outputs: [/encoder/2/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_1 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Gather [Gather] inputs: [/encoder/2/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/2/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Gather for ONNX node: /encoder/2/encoder/encoder_pos/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Gather [Gather] outputs: [/encoder/2/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_2 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Sub [Sub] inputs: [/encoder/2/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/2/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/2/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Sub for ONNX node: /encoder/2/encoder/encoder_pos/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Sub [Sub] outputs: [/encoder/2/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_3 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Add [Add] inputs: [/encoder/2/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/2/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/2/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Add for ONNX node: /encoder/2/encoder/encoder_pos/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Add_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Add [Add] outputs: [/encoder/2/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_4 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Add_1 [Add] inputs: [/encoder/2/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/2/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/2/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Add_1 for ONNX node: /encoder/2/encoder/encoder_pos/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Add_1 [Add] outputs: [/encoder/2/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_5 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/2/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Unsqueeze for ONNX node: /encoder/2/encoder/encoder_pos/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_6 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/2/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/2/encoder/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_7 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_8 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Slice [Slice] inputs: [/encoder/2/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/2/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Constant_output_0 for ONNX node: /encoder/2/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Slice for ONNX node: /encoder/2/encoder/encoder_pos/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Slice [Slice] outputs: [/encoder/2/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Constant_9 [Constant] outputs: [/encoder/2/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/2/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/2/encoder/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9335 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9335 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9335 for ONNX node: onnx::MatMul_9335 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/in_proj/Add for ONNX node: /encoder/2/encoder/0/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice [Slice] inputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Slice for ONNX node: /encoder/2/encoder/0/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice [Slice] outputs: [/encoder/2/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Slice_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/2/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/2/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Slice_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/2/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2173 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2173 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2173 [Constant] outputs: [onnx::Unsqueeze_3057 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3057 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3057 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2175 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2175 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2175 [Constant] outputs: [onnx::Unsqueeze_3059 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3059 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3059 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2180 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2180 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2180 [Constant] outputs: [onnx::Unsqueeze_3066 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3066 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3066 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2182 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2182 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2182 [Constant] outputs: [onnx::Unsqueeze_3068 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3068 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3068 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2188 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2188 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2188 [Constant] outputs: [onnx::Unsqueeze_3076 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3076 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3076 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2190 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2190 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2190 [Constant] outputs: [onnx::Unsqueeze_3078 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3078 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3078 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Transpose for ONNX node: /encoder/2/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Transpose_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Transpose_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/MatMul for ONNX node: /encoder/2/encoder/0/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9342 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9342 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9342 for ONNX node: onnx::MatMul_9342 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Mul [Mul] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Mul for ONNX node: /encoder/2/encoder/0/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Mul [Mul] outputs: [/encoder/2/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Sub [Sub] inputs: [/encoder/2/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Sub for ONNX node: /encoder/2/encoder/0/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Sub [Sub] outputs: [/encoder/2/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2207 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2207 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2207 [Constant] outputs: [onnx::Unsqueeze_3099 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3099 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_3099 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Transpose_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/2/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/MatMul_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather_3 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_4 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather_4 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_5 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Gather_5 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/2/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Sub_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Cast for ONNX node: /encoder/2/encoder/0/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast [Cast] outputs: [/encoder/2/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Range [Range] inputs: [/encoder/2/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Range for ONNX node: /encoder/2/encoder/0/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Range [Range] outputs: [/encoder/2/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Cast_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/2/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Range_1 [Range] inputs: [/encoder/2/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Range_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Range_1 [Range] outputs: [/encoder/2/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Mul_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2238 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2238 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2238 [Constant] outputs: [onnx::Unsqueeze_3132 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3132 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3132 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_4 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2241 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2241 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2241 [Constant] outputs: [onnx::Unsqueeze_3135 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3135 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3135 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_5 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Shape_6 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/2/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/2/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/2/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Expand for ONNX node: /encoder/2/encoder/0/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Expand [Expand] outputs: [/encoder/2/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Tile [Tile] inputs: [/encoder/2/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Tile for ONNX node: /encoder/2/encoder/0/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Tile [Tile] outputs: [/encoder/2/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Add [Add] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Add for ONNX node: /encoder/2/encoder/0/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Add [Add] outputs: [/encoder/2/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2252 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2252 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2252 [Constant] outputs: [onnx::Unsqueeze_3147 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3147 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_3147 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_6 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape_4 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/GatherElements for ONNX node: /encoder/2/encoder/0/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/2/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2257 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2257 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2257 [Constant] outputs: [onnx::Unsqueeze_3152 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3152 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3152 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2259 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2259 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2259 [Constant] outputs: [onnx::Unsqueeze_3154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3154 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2261 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2261 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2261 [Constant] outputs: [onnx::Unsqueeze_3156 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3156 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3156 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2263 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2263 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2263 [Constant] outputs: [onnx::Unsqueeze_3158 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3158 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3158 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Concat_7 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/2/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/2/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Reshape_5 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/2/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Add_1 [Add] inputs: [/encoder/2/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Add_1 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Add_1 [Add] outputs: [/encoder/2/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] inputs: [/encoder/Slice_2_output_0 -> (-1, -1)[BOOL]], [/encoder/2/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Cast_2 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/2/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Constant_37 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_37 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Constant_37 [Constant] outputs: [/encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Where [Where] inputs: [/encoder/2/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [/encoder/2/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 for ONNX node: /encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Where for ONNX node: /encoder/2/encoder/0/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Where [Where] outputs: [/encoder/2/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/2/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn_weights/Softmax for ONNX node: /encoder/2/encoder/0/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/2/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9349 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9349 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9349 for ONNX node: onnx::MatMul_9349 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/in_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Sub for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Exp for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Log for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Cast for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Equal for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Where for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Mul for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9350 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9350 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9350 for ONNX node: onnx::MatMul_9350 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add [Add] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add for ONNX node: /encoder/2/encoder/0/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add [Add] outputs: [/encoder/2/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant [Constant] outputs: [/encoder/2/encoder/0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Slice [Slice] inputs: [/encoder/2/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/Constant_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Slice for ONNX node: /encoder/2/encoder/0/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Slice_output_0 for ONNX tensor: /encoder/2/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Slice [Slice] outputs: [/encoder/2/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9351 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9351 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9351 for ONNX node: onnx::MatMul_9351 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/in_proj/Add for ONNX node: /encoder/2/encoder/0/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape [Shape] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Add [Add] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Add for ONNX node: /encoder/2/encoder/0/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Add [Add] outputs: [/encoder/2/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Div [Div] inputs: [/encoder/2/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Div for ONNX node: /encoder/2/encoder/0/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Div [Div] outputs: [/encoder/2/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul [Mul] inputs: [/encoder/2/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Mul for ONNX node: /encoder/2/encoder/0/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul [Mul] outputs: [/encoder/2/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice [Slice] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Slice for ONNX node: /encoder/2/encoder/0/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice [Slice] outputs: [/encoder/2/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/2/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Mul_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Slice_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/2/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/2/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Mul_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/2/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/2/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Slice_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/2/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/2/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/2/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2327 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2327 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2327 [Constant] outputs: [onnx::Unsqueeze_3225 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3225 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3225 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2329 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2329 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2329 [Constant] outputs: [onnx::Unsqueeze_3227 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3227 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3227 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat [Concat] inputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Concat for ONNX node: /encoder/2/encoder/0/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat [Concat] outputs: [/encoder/2/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Reshape for ONNX node: /encoder/2/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/2/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/2/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Mul_3 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape_3 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather_3 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape_4 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather_4 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/2/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Shape_5 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/2/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/2/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Gather_5 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/2/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2344 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2344 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2344 [Constant] outputs: [onnx::Unsqueeze_3243 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3243 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3243 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2346 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2346 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2346 [Constant] outputs: [onnx::Unsqueeze_3245 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3245 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3245 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2348 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2348 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2348 [Constant] outputs: [onnx::Unsqueeze_3247 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3247 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_3247 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Concat_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/2/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Reshape_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/2/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Transpose for ONNX node: /encoder/2/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/2/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/MatMul for ONNX node: /encoder/2/encoder/0/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/2/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Transpose_1 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2356 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2356 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2356 [Constant] outputs: [onnx::Unsqueeze_3256 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3256 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3256 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2358 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2358 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2358 [Constant] outputs: [onnx::Unsqueeze_3258 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3258 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3258 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/2/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Concat_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/2/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Reshape_2 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/2/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/Mul_4 for ONNX node: /encoder/2/encoder/0/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/2/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9355 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9355 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9355 for ONNX node: onnx::MatMul_9355 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/nonlin_attention/out_proj/Add for ONNX node: /encoder/2/encoder/0/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_1 [Add] inputs: [/encoder/2/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_1 for ONNX node: /encoder/2/encoder/0/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_1 [Add] outputs: [/encoder/2/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape [Shape] inputs: [/encoder/2/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Shape for ONNX node: /encoder/2/encoder/0/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape [Shape] outputs: [/encoder/2/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant [Constant] outputs: [/encoder/2/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather [Gather] inputs: [/encoder/2/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Constant_output_0 for ONNX node: /encoder/2/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Gather for ONNX node: /encoder/2/encoder/0/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather [Gather] outputs: [/encoder/2/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Shape_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_1 [Gather] inputs: [/encoder/2/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Gather_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_1 [Gather] outputs: [/encoder/2/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_2 [Shape] inputs: [/encoder/2/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Shape_2 for ONNX node: /encoder/2/encoder/0/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_2 [Shape] outputs: [/encoder/2/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_2 [Gather] inputs: [/encoder/2/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Gather_2 for ONNX node: /encoder/2/encoder/0/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_2 [Gather] outputs: [/encoder/2/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9356 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9356 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9356 for ONNX node: onnx::MatMul_9356 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/in_proj/Add for ONNX node: /encoder/2/encoder/0/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2378 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2378 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2378 [Constant] outputs: [onnx::Unsqueeze_3281 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3281 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3281 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2380 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2380 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2380 [Constant] outputs: [onnx::Unsqueeze_3283 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3283 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3283 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2382 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2382 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2382 [Constant] outputs: [onnx::Unsqueeze_3285 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3285 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3285 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Concat [Concat] inputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Concat for ONNX node: /encoder/2/encoder/0/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Concat [Concat] outputs: [/encoder/2/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Reshape [Reshape] inputs: [/encoder/2/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Reshape for ONNX node: /encoder/2/encoder/0/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Reshape [Reshape] outputs: [/encoder/2/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Transpose [Transpose] inputs: [/encoder/2/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Transpose for ONNX node: /encoder/2/encoder/0/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Transpose [Transpose] outputs: [/encoder/2/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_3 [Shape] inputs: [/encoder/2/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Shape_3 for ONNX node: /encoder/2/encoder/0/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Shape_3 [Shape] outputs: [/encoder/2/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_3 [Gather] inputs: [/encoder/2/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Gather_3 for ONNX node: /encoder/2/encoder/0/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Gather_3 [Gather] outputs: [/encoder/2/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/MatMul [MatMul] inputs: [/encoder/2/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/MatMul for ONNX node: /encoder/2/encoder/0/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Transpose_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Mul [Mul] inputs: [/encoder/2/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Mul for ONNX node: /encoder/2/encoder/0/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Mul [Mul] outputs: [/encoder/2/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2394 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2394 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2394 [Constant] outputs: [onnx::Unsqueeze_3298 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3298 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3298 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2396 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2396 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2396 [Constant] outputs: [onnx::Unsqueeze_3300 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3300 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3300 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2398 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2398 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2398 [Constant] outputs: [onnx::Unsqueeze_3302 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3302 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_3302 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/2/encoder/0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Concat_1 [Concat] inputs: [/encoder/2/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Concat_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Concat_1 [Concat] outputs: [/encoder/2/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/Reshape_1 for ONNX node: /encoder/2/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9358 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9358 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9358 for ONNX node: onnx::MatMul_9358 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn1/out_proj/Add for ONNX node: /encoder/2/encoder/0/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn1/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_2 [Add] inputs: [/encoder/2/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_2 for ONNX node: /encoder/2/encoder/0/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_2_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_2 [Add] outputs: [/encoder/2/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9359 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9359 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9359 for ONNX node: onnx::MatMul_9359 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/in_proj/Add for ONNX node: /encoder/2/encoder/0/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Shape [Shape] inputs: [/encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Shape for ONNX node: /encoder/2/encoder/0/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Shape [Shape] outputs: [/encoder/2/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Gather [Gather] inputs: [/encoder/2/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Gather for ONNX node: /encoder/2/encoder/0/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Gather [Gather] outputs: [/encoder/2/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Add [Add] inputs: [/encoder/2/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Add for ONNX node: /encoder/2/encoder/0/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Add [Add] outputs: [/encoder/2/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Div [Div] inputs: [/encoder/2/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Div for ONNX node: /encoder/2/encoder/0/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Div_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Div [Div] outputs: [/encoder/2/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul [Mul] inputs: [/encoder/2/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Mul for ONNX node: /encoder/2/encoder/0/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul [Mul] outputs: [/encoder/2/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Slice [Slice] inputs: [/encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Slice for ONNX node: /encoder/2/encoder/0/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Slice [Slice] outputs: [/encoder/2/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_5 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul_1 [Mul] inputs: [/encoder/2/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Mul_1 for ONNX node: /encoder/2/encoder/0/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul_1 [Mul] outputs: [/encoder/2/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Slice_1 [Slice] inputs: [/encoder/2/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Slice_1 for ONNX node: /encoder/2/encoder/0/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Slice_1 [Slice] outputs: [/encoder/2/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul_2 [Mul] inputs: [/encoder/2/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Mul_2 for ONNX node: /encoder/2/encoder/0/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Mul_2 [Mul] outputs: [/encoder/2/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Transpose [Transpose] inputs: [/encoder/2/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Transpose for ONNX node: /encoder/2/encoder/0/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Transpose [Transpose] outputs: [/encoder/2/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Shape_1 for ONNX node: /encoder/2/encoder/0/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Expand for ONNX node: /encoder/2/encoder/0/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Expand [Expand] outputs: [/encoder/2/encoder/0/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Cast [Cast] inputs: [/encoder/2/encoder/0/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Cast for ONNX node: /encoder/2/encoder/0/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Cast [Cast] outputs: [/encoder/2/encoder/0/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Constant_6 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Where [Where] inputs: [/encoder/2/encoder/0/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Where for ONNX node: /encoder/2/encoder/0/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Where [Where] outputs: [/encoder/2/encoder/0/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/0/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.0.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/Transpose_1 for ONNX node: /encoder/2/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Sub for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Exp for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Add [Add] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Add for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Log [Log] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Log for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Log [Log] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Cast for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Equal for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Where [Where] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Where for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Where [Where] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Mul for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9360 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9360 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9360 for ONNX node: onnx::MatMul_9360 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_3 [Add] inputs: [/encoder/2/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_3 for ONNX node: /encoder/2/encoder/0/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_3_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_3 [Add] outputs: [/encoder/2/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9361 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9361 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9361 for ONNX node: onnx::MatMul_9361 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/in_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Sub for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Exp for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Log for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Cast for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Equal for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Where for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Mul for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9362 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9362 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9362 for ONNX node: onnx::MatMul_9362 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_4 [Add] inputs: [/encoder/2/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_4 for ONNX node: /encoder/2/encoder/0/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_4_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_4 [Add] outputs: [/encoder/2/encoder/0/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Sub [Sub] inputs: [/encoder/2/encoder/0/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass_mid/Sub for ONNX node: /encoder/2/encoder/0/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Sub [Sub] outputs: [/encoder/2/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Mul [Mul] inputs: [/encoder/2/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass_mid/Mul for ONNX node: /encoder/2/encoder/0/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Mul [Mul] outputs: [/encoder/2/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Add [Add] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass_mid/Add for ONNX node: /encoder/2/encoder/0/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass_mid/Add [Add] outputs: [/encoder/2/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape [Shape] inputs: [/encoder/2/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Shape for ONNX node: /encoder/2/encoder/0/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape [Shape] outputs: [/encoder/2/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant [Constant] outputs: [/encoder/2/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather [Gather] inputs: [/encoder/2/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Constant_output_0 for ONNX node: /encoder/2/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Gather for ONNX node: /encoder/2/encoder/0/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather [Gather] outputs: [/encoder/2/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Shape_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather_1 [Gather] inputs: [/encoder/2/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Gather_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather_1 [Gather] outputs: [/encoder/2/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9363 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9363 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9363 for ONNX node: onnx::MatMul_9363 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/in_proj/Add for ONNX node: /encoder/2/encoder/0/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2480 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2480 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2480 [Constant] outputs: [onnx::Unsqueeze_3390 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3390 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3390 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2482 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2482 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2482 [Constant] outputs: [onnx::Unsqueeze_3392 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3392 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3392 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2484 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2484 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2484 [Constant] outputs: [onnx::Unsqueeze_3394 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3394 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3394 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Concat [Concat] inputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Concat for ONNX node: /encoder/2/encoder/0/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Concat [Concat] outputs: [/encoder/2/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Reshape [Reshape] inputs: [/encoder/2/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Reshape for ONNX node: /encoder/2/encoder/0/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Reshape [Reshape] outputs: [/encoder/2/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Transpose [Transpose] inputs: [/encoder/2/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Transpose for ONNX node: /encoder/2/encoder/0/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Transpose [Transpose] outputs: [/encoder/2/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape_2 [Shape] inputs: [/encoder/2/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Shape_2 for ONNX node: /encoder/2/encoder/0/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Shape_2 [Shape] outputs: [/encoder/2/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather_2 [Gather] inputs: [/encoder/2/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Gather_2 for ONNX node: /encoder/2/encoder/0/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Gather_2 [Gather] outputs: [/encoder/2/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/MatMul [MatMul] inputs: [/encoder/2/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/MatMul for ONNX node: /encoder/2/encoder/0/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Transpose_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Mul [Mul] inputs: [/encoder/2/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Mul for ONNX node: /encoder/2/encoder/0/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Mul [Mul] outputs: [/encoder/2/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2496 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2496 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2496 [Constant] outputs: [onnx::Unsqueeze_3407 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3407 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3407 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2498 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2498 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2498 [Constant] outputs: [onnx::Unsqueeze_3409 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3409 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3409 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2500 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2500 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2500 [Constant] outputs: [onnx::Unsqueeze_3411 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3411 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_3411 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/2/encoder/0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Concat_1 [Concat] inputs: [/encoder/2/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Concat_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Concat_1 [Concat] outputs: [/encoder/2/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/Reshape_1 for ONNX node: /encoder/2/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9365 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9365 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9365 for ONNX node: onnx::MatMul_9365 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/self_attn2/out_proj/Add for ONNX node: /encoder/2/encoder/0/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/self_attn2/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_5 [Add] inputs: [/encoder/2/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_5 for ONNX node: /encoder/2/encoder/0/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_5_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_5 [Add] outputs: [/encoder/2/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9366 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9366 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9366 for ONNX node: onnx::MatMul_9366 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/in_proj/Add for ONNX node: /encoder/2/encoder/0/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Shape [Shape] inputs: [/encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Shape for ONNX node: /encoder/2/encoder/0/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Shape [Shape] outputs: [/encoder/2/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Gather [Gather] inputs: [/encoder/2/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Gather for ONNX node: /encoder/2/encoder/0/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Gather [Gather] outputs: [/encoder/2/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Add [Add] inputs: [/encoder/2/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Add for ONNX node: /encoder/2/encoder/0/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Add [Add] outputs: [/encoder/2/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Div [Div] inputs: [/encoder/2/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Div for ONNX node: /encoder/2/encoder/0/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Div_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Div [Div] outputs: [/encoder/2/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul [Mul] inputs: [/encoder/2/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Mul for ONNX node: /encoder/2/encoder/0/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul [Mul] outputs: [/encoder/2/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Slice [Slice] inputs: [/encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Slice for ONNX node: /encoder/2/encoder/0/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Slice [Slice] outputs: [/encoder/2/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_5 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul_1 [Mul] inputs: [/encoder/2/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Mul_1 for ONNX node: /encoder/2/encoder/0/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul_1 [Mul] outputs: [/encoder/2/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Slice_1 [Slice] inputs: [/encoder/2/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Slice_1 for ONNX node: /encoder/2/encoder/0/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Slice_1 [Slice] outputs: [/encoder/2/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul_2 [Mul] inputs: [/encoder/2/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Mul_2 for ONNX node: /encoder/2/encoder/0/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Mul_2 [Mul] outputs: [/encoder/2/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Transpose [Transpose] inputs: [/encoder/2/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Transpose for ONNX node: /encoder/2/encoder/0/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Transpose [Transpose] outputs: [/encoder/2/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Shape_1 [Shape] inputs: [/encoder/2/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Shape_1 for ONNX node: /encoder/2/encoder/0/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Shape_1 [Shape] outputs: [/encoder/2/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Expand for ONNX node: /encoder/2/encoder/0/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Expand [Expand] outputs: [/encoder/2/encoder/0/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Cast [Cast] inputs: [/encoder/2/encoder/0/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Cast for ONNX node: /encoder/2/encoder/0/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Cast [Cast] outputs: [/encoder/2/encoder/0/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Constant_6 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Where [Where] inputs: [/encoder/2/encoder/0/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Where for ONNX node: /encoder/2/encoder/0/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Where [Where] outputs: [/encoder/2/encoder/0/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/0/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.0.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/Transpose_1 for ONNX node: /encoder/2/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Sub for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Exp for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Add [Add] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Add for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Log [Log] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Log for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Log [Log] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Cast for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Equal for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Where [Where] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Where for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Where [Where] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Mul for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9367 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9367 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9367 for ONNX node: onnx::MatMul_9367 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_6 [Add] inputs: [/encoder/2/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_6 for ONNX node: /encoder/2/encoder/0/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_6_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_6 [Add] outputs: [/encoder/2/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9368 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9368 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9368 for ONNX node: onnx::MatMul_9368 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/in_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Sub for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Exp for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Add for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Log for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Cast for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Equal for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Where for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Mul for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9369 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9369 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9369 for ONNX node: onnx::MatMul_9369 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_7 [Add] inputs: [/encoder/2/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/Add_7 for ONNX node: /encoder/2/encoder/0/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/Add_7_output_0 for ONNX tensor: /encoder/2/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/Add_7 [Add] outputs: [/encoder/2/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Sub [Sub] inputs: [/encoder/2/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.0.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.norm.bias for ONNX node: encoder.encoders.2.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Sub for ONNX node: /encoder/2/encoder/0/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Sub [Sub] outputs: [/encoder/2/encoder/0/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Constant [Constant] outputs: [/encoder/2/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Pow [Pow] inputs: [/encoder/2/encoder/0/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Constant_output_0 for ONNX node: /encoder/2/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Pow for ONNX node: /encoder/2/encoder/0/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Pow_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Pow [Pow] outputs: [/encoder/2/encoder/0/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/ReduceMean [ReduceMean] inputs: [/encoder/2/encoder/0/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/ReduceMean for ONNX node: /encoder/2/encoder/0/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/ReduceMean [ReduceMean] outputs: [/encoder/2/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Constant_1 [Constant] outputs: [/encoder/2/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Pow_1 [Pow] inputs: [/encoder/2/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Constant_1_output_0 for ONNX node: /encoder/2/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Pow_1 for ONNX node: /encoder/2/encoder/0/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Pow_1_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Pow_1 [Pow] outputs: [/encoder/2/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Exp [Exp] inputs: [encoder.encoders.2.encoder.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.norm.log_scale for ONNX node: encoder.encoders.2.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Exp for ONNX node: /encoder/2/encoder/0/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Exp_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Exp [Exp] outputs: [/encoder/2/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Mul [Mul] inputs: [/encoder/2/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Mul for ONNX node: /encoder/2/encoder/0/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Mul [Mul] outputs: [/encoder/2/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Mul_1 [Mul] inputs: [/encoder/2/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/norm/Mul_1 for ONNX node: /encoder/2/encoder/0/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/norm/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/norm/Mul_1 [Mul] outputs: [/encoder/2/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Sub [Sub] inputs: [/encoder/2/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass/Sub for ONNX node: /encoder/2/encoder/0/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass/Sub_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Sub [Sub] outputs: [/encoder/2/encoder/0/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Mul [Mul] inputs: [/encoder/2/encoder/0/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.0.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass/Mul for ONNX node: /encoder/2/encoder/0/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass/Mul_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Mul [Mul] outputs: [/encoder/2/encoder/0/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/0/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Add [Add] inputs: [/encoder/2/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/0/bypass/Add for ONNX node: /encoder/2/encoder/0/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/0/bypass/Add_output_0 for ONNX tensor: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/0/bypass/Add [Add] outputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9370 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9370 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9370 for ONNX node: onnx::MatMul_9370 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/in_proj/Add for ONNX node: /encoder/2/encoder/1/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice [Slice] inputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Slice for ONNX node: /encoder/2/encoder/1/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice [Slice] outputs: [/encoder/2/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Slice_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/2/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/2/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Slice_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/2/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2606 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2606 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2606 [Constant] outputs: [onnx::Unsqueeze_3523 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3523 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3523 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2608 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2608 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2608 [Constant] outputs: [onnx::Unsqueeze_3525 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3525 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3525 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2613 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2613 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2613 [Constant] outputs: [onnx::Unsqueeze_3532 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3532 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3532 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2615 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2615 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2615 [Constant] outputs: [onnx::Unsqueeze_3534 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3534 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3534 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2621 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2621 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2621 [Constant] outputs: [onnx::Unsqueeze_3542 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3542 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3542 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2623 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2623 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2623 [Constant] outputs: [onnx::Unsqueeze_3544 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3544 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3544 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Transpose for ONNX node: /encoder/2/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Transpose_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Transpose_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/MatMul for ONNX node: /encoder/2/encoder/1/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9377 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9377 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9377 for ONNX node: onnx::MatMul_9377 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Mul [Mul] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Mul for ONNX node: /encoder/2/encoder/1/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Mul [Mul] outputs: [/encoder/2/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Sub [Sub] inputs: [/encoder/2/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Sub for ONNX node: /encoder/2/encoder/1/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Sub [Sub] outputs: [/encoder/2/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2640 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2640 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2640 [Constant] outputs: [onnx::Unsqueeze_3565 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3565 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_3565 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Transpose_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/2/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/MatMul_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather_3 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_4 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather_4 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_5 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Gather_5 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/2/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Sub_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast [Cast] inputs: [/encoder/2/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Cast for ONNX node: /encoder/2/encoder/1/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast [Cast] outputs: [/encoder/2/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Range [Range] inputs: [/encoder/2/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Range for ONNX node: /encoder/2/encoder/1/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Range [Range] outputs: [/encoder/2/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Cast_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/2/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Range_1 [Range] inputs: [/encoder/2/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Range_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Range_1 [Range] outputs: [/encoder/2/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Mul_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2671 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2671 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2671 [Constant] outputs: [onnx::Unsqueeze_3598 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3598 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3598 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_4 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2674 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2674 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2674 [Constant] outputs: [onnx::Unsqueeze_3601 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3601 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3601 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_5 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Shape_6 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/2/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/2/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/2/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Expand [Expand] inputs: [/encoder/2/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Expand for ONNX node: /encoder/2/encoder/1/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Expand [Expand] outputs: [/encoder/2/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Tile [Tile] inputs: [/encoder/2/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Tile for ONNX node: /encoder/2/encoder/1/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Tile [Tile] outputs: [/encoder/2/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Add [Add] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Add for ONNX node: /encoder/2/encoder/1/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Add [Add] outputs: [/encoder/2/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2685 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2685 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2685 [Constant] outputs: [onnx::Unsqueeze_3613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3613 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_3613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_6 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape_4 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/GatherElements for ONNX node: /encoder/2/encoder/1/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/2/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2690 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2690 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2690 [Constant] outputs: [onnx::Unsqueeze_3618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3618 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2692 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2692 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2692 [Constant] outputs: [onnx::Unsqueeze_3620 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3620 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3620 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2694 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2694 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2694 [Constant] outputs: [onnx::Unsqueeze_3622 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3622 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3622 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2696 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2696 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2696 [Constant] outputs: [onnx::Unsqueeze_3624 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3624 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3624 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Concat_7 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/2/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/2/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Reshape_5 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/2/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Add_1 [Add] inputs: [/encoder/2/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Add_1 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Add_1 [Add] outputs: [/encoder/2/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Cast_2 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/2/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Where [Where] inputs: [/encoder/2/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/2/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Where for ONNX node: /encoder/2/encoder/1/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Where [Where] outputs: [/encoder/2/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/2/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn_weights/Softmax for ONNX node: /encoder/2/encoder/1/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/2/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9384 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9384 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9384 for ONNX node: onnx::MatMul_9384 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/in_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Sub for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Exp for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Log for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Cast for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Equal for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Where for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Mul for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9385 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9385 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9385 for ONNX node: onnx::MatMul_9385 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add [Add] inputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add for ONNX node: /encoder/2/encoder/1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add [Add] outputs: [/encoder/2/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant [Constant] outputs: [/encoder/2/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Slice [Slice] inputs: [/encoder/2/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Slice for ONNX node: /encoder/2/encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Slice_output_0 for ONNX tensor: /encoder/2/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Slice [Slice] outputs: [/encoder/2/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9386 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9386 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9386 for ONNX node: onnx::MatMul_9386 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/in_proj/Add for ONNX node: /encoder/2/encoder/1/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape [Shape] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Add [Add] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Add for ONNX node: /encoder/2/encoder/1/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Add [Add] outputs: [/encoder/2/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Div [Div] inputs: [/encoder/2/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Div for ONNX node: /encoder/2/encoder/1/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Div [Div] outputs: [/encoder/2/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul [Mul] inputs: [/encoder/2/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Mul for ONNX node: /encoder/2/encoder/1/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul [Mul] outputs: [/encoder/2/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice [Slice] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Slice for ONNX node: /encoder/2/encoder/1/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice [Slice] outputs: [/encoder/2/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/2/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Mul_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Slice_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/2/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/2/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Mul_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/2/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/2/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Slice_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/2/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/2/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/2/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2758 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2758 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2758 [Constant] outputs: [onnx::Unsqueeze_3689 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3689 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3689 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2760 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2760 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2760 [Constant] outputs: [onnx::Unsqueeze_3691 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3691 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3691 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat [Concat] inputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Concat for ONNX node: /encoder/2/encoder/1/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat [Concat] outputs: [/encoder/2/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Reshape for ONNX node: /encoder/2/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/2/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/2/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Mul_3 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape_3 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather_3 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape_4 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather_4 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/2/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Shape_5 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/2/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/2/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Gather_5 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/2/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2775 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2775 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2775 [Constant] outputs: [onnx::Unsqueeze_3707 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3707 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3707 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2777 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2777 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2777 [Constant] outputs: [onnx::Unsqueeze_3709 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3709 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3709 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2779 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2779 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2779 [Constant] outputs: [onnx::Unsqueeze_3711 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3711 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_3711 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Concat_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/2/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Reshape_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/2/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Transpose for ONNX node: /encoder/2/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/2/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/MatMul for ONNX node: /encoder/2/encoder/1/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/2/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Transpose_1 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2787 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2787 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2787 [Constant] outputs: [onnx::Unsqueeze_3720 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3720 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_3720 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2789 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2789 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2789 [Constant] outputs: [onnx::Unsqueeze_3722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3722 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_3722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/2/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Concat_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/2/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Reshape_2 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/2/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/Mul_4 for ONNX node: /encoder/2/encoder/1/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/2/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9390 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9390 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9390 for ONNX node: onnx::MatMul_9390 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/nonlin_attention/out_proj/Add for ONNX node: /encoder/2/encoder/1/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_1 [Add] inputs: [/encoder/2/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_1 for ONNX node: /encoder/2/encoder/1/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_1 [Add] outputs: [/encoder/2/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape [Shape] inputs: [/encoder/2/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Shape for ONNX node: /encoder/2/encoder/1/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape [Shape] outputs: [/encoder/2/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant [Constant] outputs: [/encoder/2/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather [Gather] inputs: [/encoder/2/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Constant_output_0 for ONNX node: /encoder/2/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Gather for ONNX node: /encoder/2/encoder/1/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather [Gather] outputs: [/encoder/2/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Shape_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_1 [Gather] inputs: [/encoder/2/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Gather_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_1 [Gather] outputs: [/encoder/2/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_2 [Shape] inputs: [/encoder/2/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Shape_2 for ONNX node: /encoder/2/encoder/1/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_2 [Shape] outputs: [/encoder/2/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_2 [Gather] inputs: [/encoder/2/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Gather_2 for ONNX node: /encoder/2/encoder/1/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_2 [Gather] outputs: [/encoder/2/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9391 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9391 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9391 for ONNX node: onnx::MatMul_9391 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/in_proj/Add for ONNX node: /encoder/2/encoder/1/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2809 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2809 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2809 [Constant] outputs: [onnx::Unsqueeze_3745 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3745 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3745 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2811 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2811 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2811 [Constant] outputs: [onnx::Unsqueeze_3747 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3747 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3747 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2813 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2813 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2813 [Constant] outputs: [onnx::Unsqueeze_3749 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3749 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3749 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Concat [Concat] inputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Concat for ONNX node: /encoder/2/encoder/1/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Concat [Concat] outputs: [/encoder/2/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Reshape [Reshape] inputs: [/encoder/2/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Reshape for ONNX node: /encoder/2/encoder/1/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Reshape [Reshape] outputs: [/encoder/2/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Transpose [Transpose] inputs: [/encoder/2/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Transpose for ONNX node: /encoder/2/encoder/1/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Transpose [Transpose] outputs: [/encoder/2/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_3 [Shape] inputs: [/encoder/2/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Shape_3 for ONNX node: /encoder/2/encoder/1/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Shape_3 [Shape] outputs: [/encoder/2/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_3 [Gather] inputs: [/encoder/2/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Gather_3 for ONNX node: /encoder/2/encoder/1/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Gather_3 [Gather] outputs: [/encoder/2/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/MatMul [MatMul] inputs: [/encoder/2/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/MatMul for ONNX node: /encoder/2/encoder/1/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Transpose_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Mul [Mul] inputs: [/encoder/2/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Mul for ONNX node: /encoder/2/encoder/1/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Mul [Mul] outputs: [/encoder/2/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2825 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2825 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2825 [Constant] outputs: [onnx::Unsqueeze_3762 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3762 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3762 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2827 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2827 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2827 [Constant] outputs: [onnx::Unsqueeze_3764 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3764 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3764 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2829 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2829 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2829 [Constant] outputs: [onnx::Unsqueeze_3766 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3766 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_3766 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/2/encoder/1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Concat_1 [Concat] inputs: [/encoder/2/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Concat_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Concat_1 [Concat] outputs: [/encoder/2/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/Reshape_1 for ONNX node: /encoder/2/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9393 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9393 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9393 for ONNX node: onnx::MatMul_9393 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn1/out_proj/Add for ONNX node: /encoder/2/encoder/1/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn1/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_2 [Add] inputs: [/encoder/2/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_2 for ONNX node: /encoder/2/encoder/1/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_2_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_2 [Add] outputs: [/encoder/2/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9394 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9394 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9394 for ONNX node: onnx::MatMul_9394 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/in_proj/Add for ONNX node: /encoder/2/encoder/1/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Shape [Shape] inputs: [/encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Shape for ONNX node: /encoder/2/encoder/1/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Shape [Shape] outputs: [/encoder/2/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Gather [Gather] inputs: [/encoder/2/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Gather for ONNX node: /encoder/2/encoder/1/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Gather [Gather] outputs: [/encoder/2/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Add [Add] inputs: [/encoder/2/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Add for ONNX node: /encoder/2/encoder/1/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Add [Add] outputs: [/encoder/2/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Div [Div] inputs: [/encoder/2/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Div for ONNX node: /encoder/2/encoder/1/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Div_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Div [Div] outputs: [/encoder/2/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul [Mul] inputs: [/encoder/2/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Mul for ONNX node: /encoder/2/encoder/1/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul [Mul] outputs: [/encoder/2/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Slice [Slice] inputs: [/encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Slice for ONNX node: /encoder/2/encoder/1/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Slice [Slice] outputs: [/encoder/2/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_5 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul_1 [Mul] inputs: [/encoder/2/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Mul_1 for ONNX node: /encoder/2/encoder/1/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul_1 [Mul] outputs: [/encoder/2/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Slice_1 [Slice] inputs: [/encoder/2/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Slice_1 for ONNX node: /encoder/2/encoder/1/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Slice_1 [Slice] outputs: [/encoder/2/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul_2 [Mul] inputs: [/encoder/2/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Mul_2 for ONNX node: /encoder/2/encoder/1/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Mul_2 [Mul] outputs: [/encoder/2/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Transpose [Transpose] inputs: [/encoder/2/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Transpose for ONNX node: /encoder/2/encoder/1/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Transpose [Transpose] outputs: [/encoder/2/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Shape_1 for ONNX node: /encoder/2/encoder/1/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Expand for ONNX node: /encoder/2/encoder/1/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Expand [Expand] outputs: [/encoder/2/encoder/1/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Cast [Cast] inputs: [/encoder/2/encoder/1/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Cast for ONNX node: /encoder/2/encoder/1/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Cast [Cast] outputs: [/encoder/2/encoder/1/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Constant_6 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Where [Where] inputs: [/encoder/2/encoder/1/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Where for ONNX node: /encoder/2/encoder/1/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Where [Where] outputs: [/encoder/2/encoder/1/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/1/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.1.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/Transpose_1 for ONNX node: /encoder/2/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Sub for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Exp for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Add [Add] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Add for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Log [Log] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Log for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Log [Log] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Cast for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Equal for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Where [Where] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Where for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Where [Where] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Mul for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9395 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9395 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9395 for ONNX node: onnx::MatMul_9395 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_3 [Add] inputs: [/encoder/2/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_3 for ONNX node: /encoder/2/encoder/1/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_3_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_3 [Add] outputs: [/encoder/2/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9396 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9396 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9396 for ONNX node: onnx::MatMul_9396 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/in_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Sub for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Exp for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Log for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Cast for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Equal for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Where for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Mul for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9397 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9397 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9397 for ONNX node: onnx::MatMul_9397 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_4 [Add] inputs: [/encoder/2/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_4 for ONNX node: /encoder/2/encoder/1/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_4_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_4 [Add] outputs: [/encoder/2/encoder/1/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Sub [Sub] inputs: [/encoder/2/encoder/1/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass_mid/Sub for ONNX node: /encoder/2/encoder/1/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Sub [Sub] outputs: [/encoder/2/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Mul [Mul] inputs: [/encoder/2/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass_mid/Mul for ONNX node: /encoder/2/encoder/1/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Mul [Mul] outputs: [/encoder/2/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Add [Add] inputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass_mid/Add for ONNX node: /encoder/2/encoder/1/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass_mid/Add [Add] outputs: [/encoder/2/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape [Shape] inputs: [/encoder/2/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Shape for ONNX node: /encoder/2/encoder/1/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape [Shape] outputs: [/encoder/2/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant [Constant] outputs: [/encoder/2/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather [Gather] inputs: [/encoder/2/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Constant_output_0 for ONNX node: /encoder/2/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Gather for ONNX node: /encoder/2/encoder/1/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather [Gather] outputs: [/encoder/2/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Shape_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather_1 [Gather] inputs: [/encoder/2/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Gather_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather_1 [Gather] outputs: [/encoder/2/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9398 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9398 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9398 for ONNX node: onnx::MatMul_9398 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/in_proj/Add for ONNX node: /encoder/2/encoder/1/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2911 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2911 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2911 [Constant] outputs: [onnx::Unsqueeze_3854 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3854 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3854 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2913 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2913 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2913 [Constant] outputs: [onnx::Unsqueeze_3856 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3856 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3856 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2915 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2915 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2915 [Constant] outputs: [onnx::Unsqueeze_3858 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3858 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_3858 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Concat [Concat] inputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Concat for ONNX node: /encoder/2/encoder/1/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Concat [Concat] outputs: [/encoder/2/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Reshape [Reshape] inputs: [/encoder/2/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Reshape for ONNX node: /encoder/2/encoder/1/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Reshape [Reshape] outputs: [/encoder/2/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Transpose [Transpose] inputs: [/encoder/2/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Transpose for ONNX node: /encoder/2/encoder/1/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Transpose [Transpose] outputs: [/encoder/2/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape_2 [Shape] inputs: [/encoder/2/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Shape_2 for ONNX node: /encoder/2/encoder/1/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Shape_2 [Shape] outputs: [/encoder/2/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather_2 [Gather] inputs: [/encoder/2/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Gather_2 for ONNX node: /encoder/2/encoder/1/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Gather_2 [Gather] outputs: [/encoder/2/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/MatMul [MatMul] inputs: [/encoder/2/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/MatMul for ONNX node: /encoder/2/encoder/1/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Transpose_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Mul [Mul] inputs: [/encoder/2/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Mul for ONNX node: /encoder/2/encoder/1/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Mul [Mul] outputs: [/encoder/2/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2927 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2927 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2927 [Constant] outputs: [onnx::Unsqueeze_3871 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3871 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3871 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2929 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2929 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2929 [Constant] outputs: [onnx::Unsqueeze_3873 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3873 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3873 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_2931 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_2931 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_2931 [Constant] outputs: [onnx::Unsqueeze_3875 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3875 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_3875 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/2/encoder/1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Concat_1 [Concat] inputs: [/encoder/2/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Concat_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Concat_1 [Concat] outputs: [/encoder/2/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/Reshape_1 for ONNX node: /encoder/2/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9400 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9400 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9400 for ONNX node: onnx::MatMul_9400 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/self_attn2/out_proj/Add for ONNX node: /encoder/2/encoder/1/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/self_attn2/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_5 [Add] inputs: [/encoder/2/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_5 for ONNX node: /encoder/2/encoder/1/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_5_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_5 [Add] outputs: [/encoder/2/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9401 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9401 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9401 for ONNX node: onnx::MatMul_9401 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/in_proj/Add for ONNX node: /encoder/2/encoder/1/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Shape [Shape] inputs: [/encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Shape for ONNX node: /encoder/2/encoder/1/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Shape [Shape] outputs: [/encoder/2/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Gather [Gather] inputs: [/encoder/2/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Gather for ONNX node: /encoder/2/encoder/1/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Gather [Gather] outputs: [/encoder/2/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Add [Add] inputs: [/encoder/2/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Add for ONNX node: /encoder/2/encoder/1/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Add [Add] outputs: [/encoder/2/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Div [Div] inputs: [/encoder/2/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Div for ONNX node: /encoder/2/encoder/1/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Div_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Div [Div] outputs: [/encoder/2/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul [Mul] inputs: [/encoder/2/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Mul for ONNX node: /encoder/2/encoder/1/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul [Mul] outputs: [/encoder/2/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Slice [Slice] inputs: [/encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Slice for ONNX node: /encoder/2/encoder/1/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Slice [Slice] outputs: [/encoder/2/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_5 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul_1 [Mul] inputs: [/encoder/2/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Mul_1 for ONNX node: /encoder/2/encoder/1/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul_1 [Mul] outputs: [/encoder/2/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Slice_1 [Slice] inputs: [/encoder/2/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Slice_1 for ONNX node: /encoder/2/encoder/1/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Slice_1 [Slice] outputs: [/encoder/2/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul_2 [Mul] inputs: [/encoder/2/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Mul_2 for ONNX node: /encoder/2/encoder/1/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Mul_2 [Mul] outputs: [/encoder/2/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Transpose [Transpose] inputs: [/encoder/2/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Transpose for ONNX node: /encoder/2/encoder/1/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Transpose [Transpose] outputs: [/encoder/2/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Shape_1 [Shape] inputs: [/encoder/2/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Shape_1 for ONNX node: /encoder/2/encoder/1/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Shape_1 [Shape] outputs: [/encoder/2/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Expand for ONNX node: /encoder/2/encoder/1/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Expand [Expand] outputs: [/encoder/2/encoder/1/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Cast [Cast] inputs: [/encoder/2/encoder/1/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Cast for ONNX node: /encoder/2/encoder/1/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Cast [Cast] outputs: [/encoder/2/encoder/1/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Constant_6 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Where [Where] inputs: [/encoder/2/encoder/1/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Where for ONNX node: /encoder/2/encoder/1/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Where [Where] outputs: [/encoder/2/encoder/1/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/1/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.1.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/Transpose_1 for ONNX node: /encoder/2/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Sub for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Exp for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Add [Add] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Add for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Log [Log] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Log for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Log [Log] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Cast for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Equal for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Where [Where] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Where for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Where [Where] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Mul for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9402 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9402 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9402 for ONNX node: onnx::MatMul_9402 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_6 [Add] inputs: [/encoder/2/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_6 for ONNX node: /encoder/2/encoder/1/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_6_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_6 [Add] outputs: [/encoder/2/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9403 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9403 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9403 for ONNX node: onnx::MatMul_9403 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/in_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Sub for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Exp for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Add for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Log for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Cast for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Equal for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Where for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Mul for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9404 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9404 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9404 for ONNX node: onnx::MatMul_9404 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_7 [Add] inputs: [/encoder/2/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/Add_7 for ONNX node: /encoder/2/encoder/1/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/Add_7_output_0 for ONNX tensor: /encoder/2/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/Add_7 [Add] outputs: [/encoder/2/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Sub [Sub] inputs: [/encoder/2/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.1.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.norm.bias for ONNX node: encoder.encoders.2.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Sub for ONNX node: /encoder/2/encoder/1/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Sub [Sub] outputs: [/encoder/2/encoder/1/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Constant [Constant] outputs: [/encoder/2/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Pow [Pow] inputs: [/encoder/2/encoder/1/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Constant_output_0 for ONNX node: /encoder/2/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Pow for ONNX node: /encoder/2/encoder/1/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Pow_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Pow [Pow] outputs: [/encoder/2/encoder/1/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/ReduceMean [ReduceMean] inputs: [/encoder/2/encoder/1/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/ReduceMean for ONNX node: /encoder/2/encoder/1/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/ReduceMean [ReduceMean] outputs: [/encoder/2/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Constant_1 [Constant] outputs: [/encoder/2/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Pow_1 [Pow] inputs: [/encoder/2/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Constant_1_output_0 for ONNX node: /encoder/2/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Pow_1 for ONNX node: /encoder/2/encoder/1/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Pow_1_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Pow_1 [Pow] outputs: [/encoder/2/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Exp [Exp] inputs: [encoder.encoders.2.encoder.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.norm.log_scale for ONNX node: encoder.encoders.2.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Exp for ONNX node: /encoder/2/encoder/1/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Exp_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Exp [Exp] outputs: [/encoder/2/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Mul [Mul] inputs: [/encoder/2/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Mul for ONNX node: /encoder/2/encoder/1/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Mul [Mul] outputs: [/encoder/2/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Mul_1 [Mul] inputs: [/encoder/2/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/norm/Mul_1 for ONNX node: /encoder/2/encoder/1/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/norm/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/norm/Mul_1 [Mul] outputs: [/encoder/2/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Sub [Sub] inputs: [/encoder/2/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass/Sub for ONNX node: /encoder/2/encoder/1/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass/Sub_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Sub [Sub] outputs: [/encoder/2/encoder/1/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Mul [Mul] inputs: [/encoder/2/encoder/1/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.1.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass/Mul for ONNX node: /encoder/2/encoder/1/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass/Mul_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Mul [Mul] outputs: [/encoder/2/encoder/1/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/1/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Add [Add] inputs: [/encoder/2/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/1/bypass/Add for ONNX node: /encoder/2/encoder/1/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/1/bypass/Add_output_0 for ONNX tensor: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/1/bypass/Add [Add] outputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9405 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9405 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9405 for ONNX node: onnx::MatMul_9405 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/in_proj/Add for ONNX node: /encoder/2/encoder/2/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice [Slice] inputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Slice for ONNX node: /encoder/2/encoder/2/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice [Slice] outputs: [/encoder/2/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Slice_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/2/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/2/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Slice_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/2/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3037 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3037 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3037 [Constant] outputs: [onnx::Unsqueeze_3987 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3987 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3987 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3039 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3039 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3039 [Constant] outputs: [onnx::Unsqueeze_3989 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3989 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3989 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3044 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3044 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3044 [Constant] outputs: [onnx::Unsqueeze_3996 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3996 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_3996 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3046 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3046 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3046 [Constant] outputs: [onnx::Unsqueeze_3998 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_3998 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_3998 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3052 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3052 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3052 [Constant] outputs: [onnx::Unsqueeze_4006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4006 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3054 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3054 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3054 [Constant] outputs: [onnx::Unsqueeze_4008 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4008 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4008 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose [Transpose] inputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Transpose for ONNX node: /encoder/2/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose [Transpose] outputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Transpose_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Transpose_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/MatMul [MatMul] inputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/MatMul for ONNX node: /encoder/2/encoder/2/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9412 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/2/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9412 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9412 for ONNX node: onnx::MatMul_9412 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Mul [Mul] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Mul for ONNX node: /encoder/2/encoder/2/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Mul [Mul] outputs: [/encoder/2/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Sub [Sub] inputs: [/encoder/2/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Sub for ONNX node: /encoder/2/encoder/2/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Sub [Sub] outputs: [/encoder/2/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3071 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3071 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3071 [Constant] outputs: [onnx::Unsqueeze_4029 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4029 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_4029 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Transpose_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/2/encoder/2/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/MatMul_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather_3 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_4 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather_4 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_5 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Gather_5 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/2/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Sub_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast [Cast] inputs: [/encoder/2/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Cast for ONNX node: /encoder/2/encoder/2/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast [Cast] outputs: [/encoder/2/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Range [Range] inputs: [/encoder/2/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Range for ONNX node: /encoder/2/encoder/2/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Range [Range] outputs: [/encoder/2/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Cast_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/2/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Range_1 [Range] inputs: [/encoder/2/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Range_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Range_1 [Range] outputs: [/encoder/2/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Mul_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3102 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3102 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3102 [Constant] outputs: [onnx::Unsqueeze_4062 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4062 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4062 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_4 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3105 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3105 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3105 [Constant] outputs: [onnx::Unsqueeze_4065 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4065 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4065 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_5 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Shape_6 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/2/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/2/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/2/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Expand [Expand] inputs: [/encoder/2/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Expand for ONNX node: /encoder/2/encoder/2/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Expand [Expand] outputs: [/encoder/2/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Tile [Tile] inputs: [/encoder/2/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Tile for ONNX node: /encoder/2/encoder/2/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Tile [Tile] outputs: [/encoder/2/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Add [Add] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Add for ONNX node: /encoder/2/encoder/2/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Add [Add] outputs: [/encoder/2/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3116 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3116 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3116 [Constant] outputs: [onnx::Unsqueeze_4077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4077 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_4077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_6 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape_4 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/GatherElements for ONNX node: /encoder/2/encoder/2/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/2/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3121 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3121 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3121 [Constant] outputs: [onnx::Unsqueeze_4082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4082 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3123 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3123 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3123 [Constant] outputs: [onnx::Unsqueeze_4084 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4084 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4084 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3125 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3125 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3125 [Constant] outputs: [onnx::Unsqueeze_4086 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4086 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4086 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3127 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3127 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3127 [Constant] outputs: [onnx::Unsqueeze_4088 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4088 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4088 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Concat_7 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/2/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/2/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Reshape_5 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/2/encoder/2/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Add_1 [Add] inputs: [/encoder/2/encoder/2/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Add_1 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Add_1 [Add] outputs: [/encoder/2/encoder/2/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Cast_2 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/2/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Where [Where] inputs: [/encoder/2/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/2/encoder/2/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Where for ONNX node: /encoder/2/encoder/2/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Where [Where] outputs: [/encoder/2/encoder/2/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Softmax [Softmax] inputs: [/encoder/2/encoder/2/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn_weights/Softmax for ONNX node: /encoder/2/encoder/2/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn_weights/Softmax [Softmax] outputs: [/encoder/2/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9419 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9419 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9419 for ONNX node: onnx::MatMul_9419 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/in_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Sub for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Exp for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Add [Add] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Log [Log] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Log for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Log [Log] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Cast for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Equal for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Where [Where] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Where for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Where [Where] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Mul for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9420 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9420 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9420 for ONNX node: onnx::MatMul_9420 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add [Add] inputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add for ONNX node: /encoder/2/encoder/2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add [Add] outputs: [/encoder/2/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant [Constant] outputs: [/encoder/2/encoder/2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Slice [Slice] inputs: [/encoder/2/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/Constant_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Slice for ONNX node: /encoder/2/encoder/2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Slice_output_0 for ONNX tensor: /encoder/2/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Slice [Slice] outputs: [/encoder/2/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9421 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9421 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9421 for ONNX node: onnx::MatMul_9421 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/in_proj/Add for ONNX node: /encoder/2/encoder/2/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape [Shape] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Add [Add] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Add for ONNX node: /encoder/2/encoder/2/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Add [Add] outputs: [/encoder/2/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Div [Div] inputs: [/encoder/2/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Div for ONNX node: /encoder/2/encoder/2/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Div [Div] outputs: [/encoder/2/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul [Mul] inputs: [/encoder/2/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Mul for ONNX node: /encoder/2/encoder/2/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul [Mul] outputs: [/encoder/2/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice [Slice] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Slice for ONNX node: /encoder/2/encoder/2/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice [Slice] outputs: [/encoder/2/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/2/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Mul_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Slice_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/2/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/2/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Mul_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/2/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/2/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Slice_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/2/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/2/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh for ONNX node: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/2/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3189 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3189 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3189 [Constant] outputs: [onnx::Unsqueeze_4153 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4153 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4153 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3191 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3191 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3191 [Constant] outputs: [onnx::Unsqueeze_4155 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4155 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4155 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat [Concat] inputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Concat for ONNX node: /encoder/2/encoder/2/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat [Concat] outputs: [/encoder/2/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape [Reshape] inputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Reshape for ONNX node: /encoder/2/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape [Reshape] outputs: [/encoder/2/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/2/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Mul_3 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape_3 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather_3 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape_4 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather_4 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/2/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Shape_5 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/2/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/2/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Gather_5 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/2/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3206 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3206 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3206 [Constant] outputs: [onnx::Unsqueeze_4171 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4171 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4171 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3208 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3208 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3208 [Constant] outputs: [onnx::Unsqueeze_4173 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4173 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4173 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3210 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3210 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3210 [Constant] outputs: [onnx::Unsqueeze_4175 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4175 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_4175 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Concat_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/2/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Reshape_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Transpose [Transpose] inputs: [/encoder/2/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Transpose for ONNX node: /encoder/2/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Transpose [Transpose] outputs: [/encoder/2/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/MatMul for ONNX node: /encoder/2/encoder/2/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/MatMul [MatMul] outputs: [/encoder/2/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Transpose_1 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3218 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3218 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3218 [Constant] outputs: [onnx::Unsqueeze_4184 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4184 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4184 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3220 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3220 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3220 [Constant] outputs: [onnx::Unsqueeze_4186 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4186 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/2/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4186 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/2/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Concat_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/2/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/2/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Reshape_2 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/2/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/2/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/Mul_4 for ONNX node: /encoder/2/encoder/2/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/2/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9425 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9425 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9425 for ONNX node: onnx::MatMul_9425 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/nonlin_attention/out_proj/Add for ONNX node: /encoder/2/encoder/2/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_1 [Add] inputs: [/encoder/2/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_1 for ONNX node: /encoder/2/encoder/2/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_1 [Add] outputs: [/encoder/2/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape [Shape] inputs: [/encoder/2/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Shape for ONNX node: /encoder/2/encoder/2/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape [Shape] outputs: [/encoder/2/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant [Constant] outputs: [/encoder/2/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather [Gather] inputs: [/encoder/2/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Constant_output_0 for ONNX node: /encoder/2/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Gather for ONNX node: /encoder/2/encoder/2/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather [Gather] outputs: [/encoder/2/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Shape_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_1 [Gather] inputs: [/encoder/2/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Gather_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_1 [Gather] outputs: [/encoder/2/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_2 [Shape] inputs: [/encoder/2/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Shape_2 for ONNX node: /encoder/2/encoder/2/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_2 [Shape] outputs: [/encoder/2/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_2 [Gather] inputs: [/encoder/2/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Gather_2 for ONNX node: /encoder/2/encoder/2/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_2 [Gather] outputs: [/encoder/2/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9426 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9426 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9426 for ONNX node: onnx::MatMul_9426 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/in_proj/Add for ONNX node: /encoder/2/encoder/2/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3240 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3240 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3240 [Constant] outputs: [onnx::Unsqueeze_4209 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4209 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4209 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3242 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3242 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3242 [Constant] outputs: [onnx::Unsqueeze_4211 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4211 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4211 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3244 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3244 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3244 [Constant] outputs: [onnx::Unsqueeze_4213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4213 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze_2 for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Concat [Concat] inputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Concat for ONNX node: /encoder/2/encoder/2/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Concat_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Concat [Concat] outputs: [/encoder/2/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Reshape [Reshape] inputs: [/encoder/2/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Reshape for ONNX node: /encoder/2/encoder/2/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Reshape [Reshape] outputs: [/encoder/2/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Transpose [Transpose] inputs: [/encoder/2/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Transpose for ONNX node: /encoder/2/encoder/2/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Transpose [Transpose] outputs: [/encoder/2/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_3 [Shape] inputs: [/encoder/2/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Shape_3 for ONNX node: /encoder/2/encoder/2/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Shape_3 [Shape] outputs: [/encoder/2/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_3 [Gather] inputs: [/encoder/2/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Gather_3 for ONNX node: /encoder/2/encoder/2/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Gather_3 [Gather] outputs: [/encoder/2/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/MatMul [MatMul] inputs: [/encoder/2/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/MatMul for ONNX node: /encoder/2/encoder/2/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Transpose_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Mul [Mul] inputs: [/encoder/2/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Mul for ONNX node: /encoder/2/encoder/2/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Mul [Mul] outputs: [/encoder/2/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3256 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3256 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3256 [Constant] outputs: [onnx::Unsqueeze_4226 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4226 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4226 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze_3 for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3258 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3258 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3258 [Constant] outputs: [onnx::Unsqueeze_4228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4228 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze_4 for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3260 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3260 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3260 [Constant] outputs: [onnx::Unsqueeze_4230 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4230 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_4230 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Unsqueeze_5 for ONNX node: /encoder/2/encoder/2/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Concat_1 [Concat] inputs: [/encoder/2/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Concat_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Concat_1 [Concat] outputs: [/encoder/2/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/Reshape_1 for ONNX node: /encoder/2/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9428 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9428 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9428 for ONNX node: onnx::MatMul_9428 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn1/out_proj/Add for ONNX node: /encoder/2/encoder/2/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn1/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_2 [Add] inputs: [/encoder/2/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_2 for ONNX node: /encoder/2/encoder/2/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_2_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_2 [Add] outputs: [/encoder/2/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9429 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9429 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9429 for ONNX node: onnx::MatMul_9429 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/in_proj/Add for ONNX node: /encoder/2/encoder/2/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Shape [Shape] inputs: [/encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Shape for ONNX node: /encoder/2/encoder/2/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Shape [Shape] outputs: [/encoder/2/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Gather [Gather] inputs: [/encoder/2/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Gather for ONNX node: /encoder/2/encoder/2/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Gather [Gather] outputs: [/encoder/2/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Add [Add] inputs: [/encoder/2/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Add for ONNX node: /encoder/2/encoder/2/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Add [Add] outputs: [/encoder/2/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Div [Div] inputs: [/encoder/2/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Div for ONNX node: /encoder/2/encoder/2/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Div_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Div [Div] outputs: [/encoder/2/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul [Mul] inputs: [/encoder/2/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Mul for ONNX node: /encoder/2/encoder/2/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul [Mul] outputs: [/encoder/2/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Slice [Slice] inputs: [/encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Slice for ONNX node: /encoder/2/encoder/2/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Slice_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Slice [Slice] outputs: [/encoder/2/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_5 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul_1 [Mul] inputs: [/encoder/2/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_5_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Mul_1 for ONNX node: /encoder/2/encoder/2/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul_1 [Mul] outputs: [/encoder/2/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Slice_1 [Slice] inputs: [/encoder/2/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Slice_1 for ONNX node: /encoder/2/encoder/2/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Slice_1 [Slice] outputs: [/encoder/2/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul_2 [Mul] inputs: [/encoder/2/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Mul_2 for ONNX node: /encoder/2/encoder/2/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Mul_2 [Mul] outputs: [/encoder/2/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Transpose [Transpose] inputs: [/encoder/2/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Transpose for ONNX node: /encoder/2/encoder/2/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Transpose [Transpose] outputs: [/encoder/2/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Shape_1 for ONNX node: /encoder/2/encoder/2/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Expand for ONNX node: /encoder/2/encoder/2/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Expand_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Expand [Expand] outputs: [/encoder/2/encoder/2/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Cast [Cast] inputs: [/encoder/2/encoder/2/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Cast for ONNX node: /encoder/2/encoder/2/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Cast [Cast] outputs: [/encoder/2/encoder/2/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Constant_6 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Where [Where] inputs: [/encoder/2/encoder/2/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Constant_6_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Where for ONNX node: /encoder/2/encoder/2/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Where [Where] outputs: [/encoder/2/encoder/2/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/2/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.2.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/Transpose_1 for ONNX node: /encoder/2/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Sub for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Exp for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Add [Add] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Add for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Log [Log] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Log for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Log [Log] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Cast for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Equal for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Where [Where] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Where for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Where [Where] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Mul for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9430 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9430 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9430 for ONNX node: onnx::MatMul_9430 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module1/out_proj/Add_1 for ONNX node: /encoder/2/encoder/2/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_3 [Add] inputs: [/encoder/2/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_3 for ONNX node: /encoder/2/encoder/2/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_3_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_3 [Add] outputs: [/encoder/2/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9431 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9431 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9431 for ONNX node: onnx::MatMul_9431 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/in_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Sub for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Exp for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Add [Add] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Log [Log] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Log for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Log [Log] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Cast for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Equal for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Where [Where] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Where for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Where [Where] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Mul for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9432 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9432 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9432 for ONNX node: onnx::MatMul_9432 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_4 [Add] inputs: [/encoder/2/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_4 for ONNX node: /encoder/2/encoder/2/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_4_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_4 [Add] outputs: [/encoder/2/encoder/2/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Sub [Sub] inputs: [/encoder/2/encoder/2/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass_mid/Sub for ONNX node: /encoder/2/encoder/2/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Sub [Sub] outputs: [/encoder/2/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Mul [Mul] inputs: [/encoder/2/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass_mid/Mul for ONNX node: /encoder/2/encoder/2/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Mul [Mul] outputs: [/encoder/2/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Add [Add] inputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass_mid/Add for ONNX node: /encoder/2/encoder/2/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass_mid/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass_mid/Add [Add] outputs: [/encoder/2/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape [Shape] inputs: [/encoder/2/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Shape for ONNX node: /encoder/2/encoder/2/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape [Shape] outputs: [/encoder/2/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant [Constant] outputs: [/encoder/2/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather [Gather] inputs: [/encoder/2/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Constant_output_0 for ONNX node: /encoder/2/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Gather for ONNX node: /encoder/2/encoder/2/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather [Gather] outputs: [/encoder/2/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Shape_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather_1 [Gather] inputs: [/encoder/2/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Gather_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather_1 [Gather] outputs: [/encoder/2/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9433 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9433 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9433 for ONNX node: onnx::MatMul_9433 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/2/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/in_proj/Add for ONNX node: /encoder/2/encoder/2/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3342 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3342 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3342 [Constant] outputs: [onnx::Unsqueeze_4318 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4318 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4318 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3344 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3344 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3344 [Constant] outputs: [onnx::Unsqueeze_4320 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4320 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4320 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3346 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3346 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3346 [Constant] outputs: [onnx::Unsqueeze_4322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4322 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze_2 for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Concat [Concat] inputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Concat for ONNX node: /encoder/2/encoder/2/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Concat_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Concat [Concat] outputs: [/encoder/2/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Reshape [Reshape] inputs: [/encoder/2/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/2/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Reshape for ONNX node: /encoder/2/encoder/2/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Reshape [Reshape] outputs: [/encoder/2/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Transpose [Transpose] inputs: [/encoder/2/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Transpose for ONNX node: /encoder/2/encoder/2/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Transpose [Transpose] outputs: [/encoder/2/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape_2 [Shape] inputs: [/encoder/2/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Shape_2 for ONNX node: /encoder/2/encoder/2/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Shape_2 [Shape] outputs: [/encoder/2/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather_2 [Gather] inputs: [/encoder/2/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/2/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Gather_2 for ONNX node: /encoder/2/encoder/2/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Gather_2 [Gather] outputs: [/encoder/2/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/MatMul [MatMul] inputs: [/encoder/2/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/2/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/MatMul for ONNX node: /encoder/2/encoder/2/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Transpose_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Mul [Mul] inputs: [/encoder/2/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/2/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Mul for ONNX node: /encoder/2/encoder/2/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Mul [Mul] outputs: [/encoder/2/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3358 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3358 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3358 [Constant] outputs: [onnx::Unsqueeze_4335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4335 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze_3 for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3360 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3360 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3360 [Constant] outputs: [onnx::Unsqueeze_4337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4337 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze_4 for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3362 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3362 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3362 [Constant] outputs: [onnx::Unsqueeze_4339 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4339 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_4339 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Unsqueeze_5 for ONNX node: /encoder/2/encoder/2/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Concat_1 [Concat] inputs: [/encoder/2/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Concat_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Concat_1 [Concat] outputs: [/encoder/2/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/2/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/2/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/Reshape_1 for ONNX node: /encoder/2/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/2/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9435 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9435 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9435 for ONNX node: onnx::MatMul_9435 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/self_attn2/out_proj/Add for ONNX node: /encoder/2/encoder/2/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/self_attn2/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_5 [Add] inputs: [/encoder/2/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_5 for ONNX node: /encoder/2/encoder/2/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_5_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_5 [Add] outputs: [/encoder/2/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9436 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9436 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9436 for ONNX node: onnx::MatMul_9436 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/2/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/in_proj/Add for ONNX node: /encoder/2/encoder/2/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Shape [Shape] inputs: [/encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Shape for ONNX node: /encoder/2/encoder/2/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Shape_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Shape [Shape] outputs: [/encoder/2/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Gather [Gather] inputs: [/encoder/2/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Gather for ONNX node: /encoder/2/encoder/2/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Gather_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Gather [Gather] outputs: [/encoder/2/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Add [Add] inputs: [/encoder/2/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Add for ONNX node: /encoder/2/encoder/2/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Add [Add] outputs: [/encoder/2/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Div [Div] inputs: [/encoder/2/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Div for ONNX node: /encoder/2/encoder/2/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Div_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Div [Div] outputs: [/encoder/2/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul [Mul] inputs: [/encoder/2/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Mul for ONNX node: /encoder/2/encoder/2/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul [Mul] outputs: [/encoder/2/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Slice [Slice] inputs: [/encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Slice for ONNX node: /encoder/2/encoder/2/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Slice_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Slice [Slice] outputs: [/encoder/2/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_5 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul_1 [Mul] inputs: [/encoder/2/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_5_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Mul_1 for ONNX node: /encoder/2/encoder/2/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul_1 [Mul] outputs: [/encoder/2/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Slice_1 [Slice] inputs: [/encoder/2/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/2/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/2/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Slice_1 for ONNX node: /encoder/2/encoder/2/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Slice_1 [Slice] outputs: [/encoder/2/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/2/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul_2 [Mul] inputs: [/encoder/2/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Mul_2 for ONNX node: /encoder/2/encoder/2/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Mul_2 [Mul] outputs: [/encoder/2/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Transpose [Transpose] inputs: [/encoder/2/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Transpose for ONNX node: /encoder/2/encoder/2/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Transpose [Transpose] outputs: [/encoder/2/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Shape_1 for ONNX node: /encoder/2/encoder/2/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Shape_1 [Shape] outputs: [/encoder/2/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/2/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Expand for ONNX node: /encoder/2/encoder/2/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Expand_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Expand [Expand] outputs: [/encoder/2/encoder/2/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Cast [Cast] inputs: [/encoder/2/encoder/2/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Cast for ONNX node: /encoder/2/encoder/2/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Cast [Cast] outputs: [/encoder/2/encoder/2/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Constant_6 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Where [Where] inputs: [/encoder/2/encoder/2/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/2/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/2/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Constant_6_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Where for ONNX node: /encoder/2/encoder/2/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Where [Where] outputs: [/encoder/2/encoder/2/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/2/encoder/2/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.2.encoder.layers.2.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/2/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/2/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/Transpose_1 for ONNX node: /encoder/2/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/2/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Sub for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Exp for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Add [Add] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Add for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Log [Log] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Log for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Log [Log] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Cast for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Equal for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Where [Where] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/2/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Where for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Where [Where] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Mul for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9437 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9437 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9437 for ONNX node: onnx::MatMul_9437 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/conv_module2/out_proj/Add_1 for ONNX node: /encoder/2/encoder/2/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_6 [Add] inputs: [/encoder/2/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_6 for ONNX node: /encoder/2/encoder/2/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_6_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_6 [Add] outputs: [/encoder/2/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9438 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9438 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9438 for ONNX node: onnx::MatMul_9438 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/in_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/in_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Sub for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Exp for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Add [Add] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Add for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Add [Add] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Log [Log] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Log for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Log [Log] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Cast for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Equal for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Where [Where] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Where for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Where [Where] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/2/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Mul for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9439 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9439 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9439 for ONNX node: onnx::MatMul_9439 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/2/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_7 [Add] inputs: [/encoder/2/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/Add_7 for ONNX node: /encoder/2/encoder/2/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/Add_7_output_0 for ONNX tensor: /encoder/2/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/Add_7 [Add] outputs: [/encoder/2/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Sub [Sub] inputs: [/encoder/2/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.2.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.norm.bias for ONNX node: encoder.encoders.2.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Sub for ONNX node: /encoder/2/encoder/2/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Sub [Sub] outputs: [/encoder/2/encoder/2/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Constant [Constant] outputs: [/encoder/2/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Pow [Pow] inputs: [/encoder/2/encoder/2/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Constant_output_0 for ONNX node: /encoder/2/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Pow for ONNX node: /encoder/2/encoder/2/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Pow_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Pow [Pow] outputs: [/encoder/2/encoder/2/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/ReduceMean [ReduceMean] inputs: [/encoder/2/encoder/2/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/ReduceMean for ONNX node: /encoder/2/encoder/2/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/ReduceMean_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/ReduceMean [ReduceMean] outputs: [/encoder/2/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Constant_1 [Constant] outputs: [/encoder/2/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Pow_1 [Pow] inputs: [/encoder/2/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Constant_1_output_0 for ONNX node: /encoder/2/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Pow_1 for ONNX node: /encoder/2/encoder/2/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Pow_1_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Pow_1 [Pow] outputs: [/encoder/2/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Exp [Exp] inputs: [encoder.encoders.2.encoder.layers.2.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.norm.log_scale for ONNX node: encoder.encoders.2.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Exp for ONNX node: /encoder/2/encoder/2/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Exp_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Exp [Exp] outputs: [/encoder/2/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Mul [Mul] inputs: [/encoder/2/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/2/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Mul for ONNX node: /encoder/2/encoder/2/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Mul [Mul] outputs: [/encoder/2/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Mul_1 [Mul] inputs: [/encoder/2/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/norm/Mul_1 for ONNX node: /encoder/2/encoder/2/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/norm/Mul_1_output_0 for ONNX tensor: /encoder/2/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/norm/Mul_1 [Mul] outputs: [/encoder/2/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Sub [Sub] inputs: [/encoder/2/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass/Sub for ONNX node: /encoder/2/encoder/2/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass/Sub_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Sub [Sub] outputs: [/encoder/2/encoder/2/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Mul [Mul] inputs: [/encoder/2/encoder/2/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.encoder.layers.2.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.encoder.layers.2.bypass.bypass_scale for ONNX node: encoder.encoders.2.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass/Mul for ONNX node: /encoder/2/encoder/2/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass/Mul_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Mul [Mul] outputs: [/encoder/2/encoder/2/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/encoder/2/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Add [Add] inputs: [/encoder/2/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/encoder/2/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/encoder/2/bypass/Add for ONNX node: /encoder/2/encoder/2/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/encoder/2/bypass/Add_output_0 for ONNX tensor: /encoder/2/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/encoder/2/bypass/Add [Add] outputs: [/encoder/2/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape [Shape] inputs: [/encoder/2/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Shape for ONNX node: /encoder/2/upsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Shape_output_0 for ONNX tensor: /encoder/2/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape [Shape] outputs: [/encoder/2/upsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant [Constant] outputs: [/encoder/2/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather [Gather] inputs: [/encoder/2/upsample/Shape_output_0 -> (3)[INT32]], [/encoder/2/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_output_0 for ONNX node: /encoder/2/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Gather for ONNX node: /encoder/2/upsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Gather_output_0 for ONNX tensor: /encoder/2/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather [Gather] outputs: [/encoder/2/upsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_1 [Shape] inputs: [/encoder/2/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Shape_1 for ONNX node: /encoder/2/upsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Shape_1_output_0 for ONNX tensor: /encoder/2/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_1 [Shape] outputs: [/encoder/2/upsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_1 [Constant] outputs: [/encoder/2/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather_1 [Gather] inputs: [/encoder/2/upsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/2/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_1_output_0 for ONNX node: /encoder/2/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Gather_1 for ONNX node: /encoder/2/upsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Gather_1_output_0 for ONNX tensor: /encoder/2/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather_1 [Gather] outputs: [/encoder/2/upsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_2 [Shape] inputs: [/encoder/2/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Shape_2 for ONNX node: /encoder/2/upsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Shape_2_output_0 for ONNX tensor: /encoder/2/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_2 [Shape] outputs: [/encoder/2/upsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_2 [Constant] outputs: [/encoder/2/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather_2 [Gather] inputs: [/encoder/2/upsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/2/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_2_output_0 for ONNX node: /encoder/2/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Gather_2 for ONNX node: /encoder/2/upsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Gather_2_output_0 for ONNX tensor: /encoder/2/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Gather_2 [Gather] outputs: [/encoder/2/upsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_3 [Constant] outputs: [/encoder/2/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze [Unsqueeze] inputs: [/encoder/2/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze for ONNX node: /encoder/2/upsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_4 [Constant] outputs: [/encoder/2/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/2/upsample/Gather_output_0 -> ()[INT32]], [/encoder/2/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_1 for ONNX node: /encoder/2/upsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_5 [Constant] outputs: [/encoder/2/upsample/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_6 [Constant] outputs: [/encoder/2/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/2/upsample/Gather_1_output_0 -> ()[INT32]], [/encoder/2/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_2 for ONNX node: /encoder/2/upsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_7 [Constant] outputs: [/encoder/2/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/2/upsample/Gather_2_output_0 -> ()[INT32]], [/encoder/2/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_3 for ONNX node: /encoder/2/upsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Concat [Concat] inputs: [/encoder/2/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/2/upsample/Constant_5_output_0 -> (1)[INT32]], [/encoder/2/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/2/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_5_output_0 for ONNX node: /encoder/2/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Concat for ONNX node: /encoder/2/upsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Concat_output_0 for ONNX tensor: /encoder/2/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Concat [Concat] outputs: [/encoder/2/upsample/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_8 [Constant] outputs: [/encoder/2/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Reshape [Reshape] inputs: [/encoder/2/upsample/Concat_output_0 -> (4)[INT32]], [/encoder/2/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Reshape for ONNX node: /encoder/2/upsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Reshape_output_0 for ONNX tensor: /encoder/2/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Reshape [Reshape] outputs: [/encoder/2/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_3 [Shape] inputs: [/encoder/2/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Shape_3 for ONNX node: /encoder/2/upsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Shape_3_output_0 for ONNX tensor: /encoder/2/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Shape_3 [Shape] outputs: [/encoder/2/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/2/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/2/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/2/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_9 [Constant] outputs: [/encoder/2/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Mul [Mul] inputs: [/encoder/2/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/2/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_9_output_0 for ONNX node: /encoder/2/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Mul for ONNX node: /encoder/2/upsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Mul_output_0 for ONNX tensor: /encoder/2/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Mul [Mul] outputs: [/encoder/2/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Equal [Equal] inputs: [/encoder/2/upsample/Reshape_output_0 -> (4)[INT32]], [/encoder/2/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Equal for ONNX node: /encoder/2/upsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Equal_output_0 for ONNX tensor: /encoder/2/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Equal [Equal] outputs: [/encoder/2/upsample/Equal_output_0 -> (4)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Where [Where] inputs: [/encoder/2/upsample/Equal_output_0 -> (4)[BOOL]], [/encoder/2/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/2/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Where for ONNX node: /encoder/2/upsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Where_output_0 for ONNX tensor: /encoder/2/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Where [Where] outputs: [/encoder/2/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Expand [Expand] inputs: [/encoder/2/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 384)[FLOAT]], [/encoder/2/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Expand for ONNX node: /encoder/2/upsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Expand_output_0 for ONNX tensor: /encoder/2/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Expand [Expand] outputs: [/encoder/2/upsample/Expand_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Constant_10 [Constant] outputs: [/encoder/2/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Mul_1 [Mul] inputs: [/encoder/2/upsample/Gather_output_0 -> ()[INT32]], [/encoder/2/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Constant_10_output_0 for ONNX node: /encoder/2/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Mul_1 for ONNX node: /encoder/2/upsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Mul_1_output_0 for ONNX tensor: /encoder/2/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Mul_1 [Mul] outputs: [/encoder/2/upsample/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3475 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3475 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3475 [Constant] outputs: [onnx::Unsqueeze_4458 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4458 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/2/upsample/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4458 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_4 for ONNX node: /encoder/2/upsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3477 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3477 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3477 [Constant] outputs: [onnx::Unsqueeze_4460 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4460 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/2/upsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4460 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_5 for ONNX node: /encoder/2/upsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3479 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3479 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3479 [Constant] outputs: [onnx::Unsqueeze_4462 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4462 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/2/upsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4462 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Unsqueeze_6 for ONNX node: /encoder/2/upsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/2/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/2/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Concat_1 [Concat] inputs: [/encoder/2/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/2/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/2/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Concat_1 for ONNX node: /encoder/2/upsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Concat_1_output_0 for ONNX tensor: /encoder/2/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Concat_1 [Concat] outputs: [/encoder/2/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/upsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Reshape_1 [Reshape] inputs: [/encoder/2/upsample/Expand_output_0 -> (-1, 4, -1, 384)[FLOAT]], [/encoder/2/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/upsample/Reshape_1 for ONNX node: /encoder/2/upsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/upsample/Reshape_1_output_0 for ONNX tensor: /encoder/2/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/upsample/Reshape_1 [Reshape] outputs: [/encoder/2/upsample/Reshape_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant [Constant] outputs: [/encoder/2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_1 [Constant] outputs: [/encoder/2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Unsqueeze [Unsqueeze] inputs: [/encoder/2/downsample/Gather_output_0 -> ()[INT32]], [/encoder/2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/Unsqueeze for ONNX node: /encoder/2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/Unsqueeze_output_0 for ONNX tensor: /encoder/2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Unsqueeze [Unsqueeze] outputs: [/encoder/2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_2 [Constant] outputs: [/encoder/2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Constant_3 [Constant] outputs: [/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Slice [Slice] inputs: [/encoder/2/upsample/Reshape_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/Constant_output_0 -> (1)[INT32]], [/encoder/2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/2/Constant_2_output_0 -> (1)[INT32]], [/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/Slice for ONNX node: /encoder/2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/Slice_output_0 for ONNX tensor: /encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/Slice [Slice] outputs: [/encoder/2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/out_combiner/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Sub [Sub] inputs: [/encoder/2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/out_combiner/Sub for ONNX node: /encoder/2/out_combiner/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/out_combiner/Sub_output_0 for ONNX tensor: /encoder/2/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Sub [Sub] outputs: [/encoder/2/out_combiner/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/out_combiner/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.2.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Mul [Mul] inputs: [/encoder/2/out_combiner/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.2.out_combiner.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.2.out_combiner.bypass_scale for ONNX node: encoder.encoders.2.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/out_combiner/Mul for ONNX node: /encoder/2/out_combiner/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/out_combiner/Mul_output_0 for ONNX tensor: /encoder/2/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Mul [Mul] outputs: [/encoder/2/out_combiner/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/2/out_combiner/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Add [Add] inputs: [/encoder/Concat_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/2/out_combiner/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/2/out_combiner/Add for ONNX node: /encoder/2/out_combiner/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/2/out_combiner/Add_output_0 for ONNX tensor: /encoder/2/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/2/out_combiner/Add [Add] outputs: [/encoder/2/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_6 [Shape] inputs: [/encoder/2/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_6 for ONNX node: /encoder/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_6_output_0 for ONNX tensor: /encoder/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_6 [Shape] outputs: [/encoder/Shape_6_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_20 [Constant] outputs: [/encoder/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_6 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_6 [Gather] inputs: [/encoder/Shape_6_output_0 -> (3)[INT32]], [/encoder/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_20_output_0 for ONNX node: /encoder/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_6 for ONNX node: /encoder/Gather_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_6_output_0 for ONNX tensor: /encoder/Gather_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_6 [Gather] outputs: [/encoder/Gather_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_7 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_7 [Shape] inputs: [/encoder/2/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_7 for ONNX node: /encoder/Shape_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_7_output_0 for ONNX tensor: /encoder/Shape_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_7 [Shape] outputs: [/encoder/Shape_7_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_21 [Constant] outputs: [/encoder/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_7 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_7 [Gather] inputs: [/encoder/Shape_7_output_0 -> (3)[INT32]], [/encoder/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_21_output_0 for ONNX node: /encoder/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_7 for ONNX node: /encoder/Gather_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_7_output_0 for ONNX tensor: /encoder/Gather_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_7 [Gather] outputs: [/encoder/Gather_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Shape_8 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_8 [Shape] inputs: [/encoder/2/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Shape_8 for ONNX node: /encoder/Shape_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Shape_8_output_0 for ONNX tensor: /encoder/Shape_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Shape_8 [Shape] outputs: [/encoder/Shape_8_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_22 [Constant] outputs: [/encoder/Constant_22_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Gather_8 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Shape_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_8 [Gather] inputs: [/encoder/Shape_8_output_0 -> (3)[INT32]], [/encoder/Constant_22_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_22_output_0 for ONNX node: /encoder/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Gather_8 for ONNX node: /encoder/Gather_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Gather_8_output_0 for ONNX tensor: /encoder/Gather_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Gather_8 [Gather] outputs: [/encoder/Gather_8_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_23 [Constant] outputs: [/encoder/Constant_23_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Sub_2 [Sub] inputs: [/encoder/Constant_23_output_0 -> ()[INT32]], [/encoder/Gather_8_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_23_output_0 for ONNX node: /encoder/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Sub_2 for ONNX node: /encoder/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Sub_2_output_0 for ONNX tensor: /encoder/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Sub_2 [Sub] outputs: [/encoder/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3503 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3503 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3503 [Constant] outputs: [onnx::Unsqueeze_4488 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4488 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/Gather_6_output_0 -> ()[INT32]], [onnx::Unsqueeze_4488 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_6 for ONNX node: /encoder/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_6_output_0 for ONNX tensor: /encoder/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3505 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3505 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3505 [Constant] outputs: [onnx::Unsqueeze_4490 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Gather_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4490 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/Gather_7_output_0 -> ()[INT32]], [onnx::Unsqueeze_4490 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_7 for ONNX node: /encoder/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_7_output_0 for ONNX tensor: /encoder/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3507 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3507 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3507 [Constant] outputs: [onnx::Unsqueeze_4492 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4492 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/Sub_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4492 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Unsqueeze_8 for ONNX node: /encoder/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Unsqueeze_8_output_0 for ONNX tensor: /encoder/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_4 [Concat] inputs: [/encoder/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Concat_4 for ONNX node: /encoder/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Concat_4_output_0 for ONNX tensor: /encoder/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_4 [Concat] outputs: [/encoder/Concat_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/ConstantOfShape_2 [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/ConstantOfShape_2 [ConstantOfShape] inputs: [/encoder/Concat_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/ConstantOfShape_2_output_0 for ONNX tensor: /encoder/ConstantOfShape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/ConstantOfShape_2 [ConstantOfShape] outputs: [/encoder/ConstantOfShape_2_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/ConstantOfShape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_5 [Concat] inputs: [/encoder/2/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/ConstantOfShape_2_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Concat_5 for ONNX node: /encoder/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Concat_5_output_0 for ONNX tensor: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_5 [Concat] outputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_24 [Constant] outputs: [/encoder/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_25 [Constant] outputs: [/encoder/Constant_25_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_26 [Constant] outputs: [/encoder/Constant_26_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_27 [Constant] outputs: [/encoder/Constant_27_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_3 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /GreaterOrEqual_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_3 [Slice] inputs: [/GreaterOrEqual_output_0 -> (-1, -1)[BOOL]], [/encoder/Constant_25_output_0 -> (1)[INT32]], [/encoder/Constant_26_output_0 -> (1)[INT32]], [/encoder/Constant_24_output_0 -> (1)[INT32]], [/encoder/Constant_27_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_3 for ONNX node: /encoder/Slice_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_3_output_0 for ONNX tensor: /encoder/Slice_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_3 [Slice] outputs: [/encoder/Slice_3_output_0 -> (-1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape [Shape] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Shape for ONNX node: /encoder/3/downsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Shape_output_0 for ONNX tensor: /encoder/3/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape [Shape] outputs: [/encoder/3/downsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant [Constant] outputs: [/encoder/3/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather [Gather] inputs: [/encoder/3/downsample/Shape_output_0 -> (3)[INT32]], [/encoder/3/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_output_0 for ONNX node: /encoder/3/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Gather for ONNX node: /encoder/3/downsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Gather_output_0 for ONNX tensor: /encoder/3/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather [Gather] outputs: [/encoder/3/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_1 [Shape] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Shape_1 for ONNX node: /encoder/3/downsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Shape_1_output_0 for ONNX tensor: /encoder/3/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_1 [Shape] outputs: [/encoder/3/downsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_1 [Constant] outputs: [/encoder/3/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather_1 [Gather] inputs: [/encoder/3/downsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_1_output_0 for ONNX node: /encoder/3/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Gather_1 for ONNX node: /encoder/3/downsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Gather_1_output_0 for ONNX tensor: /encoder/3/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather_1 [Gather] outputs: [/encoder/3/downsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_2 [Shape] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Shape_2 for ONNX node: /encoder/3/downsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Shape_2_output_0 for ONNX tensor: /encoder/3/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_2 [Shape] outputs: [/encoder/3/downsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_2 [Constant] outputs: [/encoder/3/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather_2 [Gather] inputs: [/encoder/3/downsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_2_output_0 for ONNX node: /encoder/3/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Gather_2 for ONNX node: /encoder/3/downsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Gather_2_output_0 for ONNX tensor: /encoder/3/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Gather_2 [Gather] outputs: [/encoder/3/downsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_3 [Constant] outputs: [/encoder/3/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Add [Add] inputs: [/encoder/3/downsample/Gather_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_3_output_0 for ONNX node: /encoder/3/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Add for ONNX node: /encoder/3/downsample/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Add_output_0 for ONNX tensor: /encoder/3/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Add [Add] outputs: [/encoder/3/downsample/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_4 [Constant] outputs: [/encoder/3/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub [Sub] inputs: [/encoder/3/downsample/Add_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_4_output_0 for ONNX node: /encoder/3/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Sub for ONNX node: /encoder/3/downsample/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Sub_output_0 for ONNX tensor: /encoder/3/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub [Sub] outputs: [/encoder/3/downsample/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_5 [Constant] outputs: [/encoder/3/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Div [Div] inputs: [/encoder/3/downsample/Sub_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_5_output_0 for ONNX node: /encoder/3/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Div for ONNX node: /encoder/3/downsample/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Div_output_0 for ONNX tensor: /encoder/3/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Div [Div] outputs: [/encoder/3/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Cast [Cast] inputs: [/encoder/3/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Cast for ONNX node: /encoder/3/downsample/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Cast_output_0 for ONNX tensor: /encoder/3/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Cast [Cast] outputs: [/encoder/3/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Cast_1 [Cast] inputs: [/encoder/3/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Cast_1 for ONNX node: /encoder/3/downsample/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Cast_1_output_0 for ONNX tensor: /encoder/3/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Cast_1 [Cast] outputs: [/encoder/3/downsample/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_6 [Constant] outputs: [/encoder/3/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul [Mul] inputs: [/encoder/3/downsample/Cast_1_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_6_output_0 for ONNX node: /encoder/3/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Mul for ONNX node: /encoder/3/downsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Mul_output_0 for ONNX tensor: /encoder/3/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul [Mul] outputs: [/encoder/3/downsample/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub_1 [Sub] inputs: [/encoder/3/downsample/Mul_output_0 -> ()[INT32]], [/encoder/3/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Sub_1 for ONNX node: /encoder/3/downsample/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Sub_1_output_0 for ONNX tensor: /encoder/3/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub_1 [Sub] outputs: [/encoder/3/downsample/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_7 [Constant] outputs: [/encoder/3/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub_2 [Sub] inputs: [/encoder/3/downsample/Gather_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_7_output_0 for ONNX node: /encoder/3/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Sub_2 for ONNX node: /encoder/3/downsample/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Sub_2_output_0 for ONNX tensor: /encoder/3/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Sub_2 [Sub] outputs: [/encoder/3/downsample/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_8 [Constant] outputs: [/encoder/3/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze [Unsqueeze] inputs: [/encoder/3/downsample/Sub_2_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze for ONNX node: /encoder/3/downsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_9 [Constant] outputs: [/encoder/3/downsample/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_10 [Constant] outputs: [/encoder/3/downsample/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_11 [Constant] outputs: [/encoder/3/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Slice [Slice] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/downsample/Constant_9_output_0 -> (1)[INT32]], [/encoder/3/downsample/Constant_10_output_0 -> (1)[INT32]], [/encoder/3/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Slice for ONNX node: /encoder/3/downsample/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Slice_output_0 for ONNX tensor: /encoder/3/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Slice [Slice] outputs: [/encoder/3/downsample/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_12 [Constant] outputs: [/encoder/3/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/downsample/Sub_1_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_1 for ONNX node: /encoder/3/downsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_13 [Constant] outputs: [/encoder/3/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/downsample/Gather_1_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_2 for ONNX node: /encoder/3/downsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_14 [Constant] outputs: [/encoder/3/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/downsample/Gather_2_output_0 -> ()[INT32]], [/encoder/3/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_3 for ONNX node: /encoder/3/downsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat [Concat] inputs: [/encoder/3/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Concat for ONNX node: /encoder/3/downsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Concat_output_0 for ONNX tensor: /encoder/3/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat [Concat] outputs: [/encoder/3/downsample/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_15 [Constant] outputs: [/encoder/3/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Reshape [Reshape] inputs: [/encoder/3/downsample/Concat_output_0 -> (3)[INT32]], [/encoder/3/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Reshape for ONNX node: /encoder/3/downsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Reshape_output_0 for ONNX tensor: /encoder/3/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Reshape [Reshape] outputs: [/encoder/3/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_3 [Shape] inputs: [/encoder/3/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Shape_3 for ONNX node: /encoder/3/downsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Shape_3_output_0 for ONNX tensor: /encoder/3/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Shape_3 [Shape] outputs: [/encoder/3/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_16 [Constant] outputs: [/encoder/3/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul_1 [Mul] inputs: [/encoder/3/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/3/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_16_output_0 for ONNX node: /encoder/3/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Mul_1 for ONNX node: /encoder/3/downsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Mul_1_output_0 for ONNX tensor: /encoder/3/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul_1 [Mul] outputs: [/encoder/3/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Equal [Equal] inputs: [/encoder/3/downsample/Reshape_output_0 -> (3)[INT32]], [/encoder/3/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Equal for ONNX node: /encoder/3/downsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Equal_output_0 for ONNX tensor: /encoder/3/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Equal [Equal] outputs: [/encoder/3/downsample/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Where [Where] inputs: [/encoder/3/downsample/Equal_output_0 -> (3)[BOOL]], [/encoder/3/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/3/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Where for ONNX node: /encoder/3/downsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Where_output_0 for ONNX tensor: /encoder/3/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Where [Where] outputs: [/encoder/3/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Expand [Expand] inputs: [/encoder/3/downsample/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Expand for ONNX node: /encoder/3/downsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Expand_output_0 for ONNX tensor: /encoder/3/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Expand [Expand] outputs: [/encoder/3/downsample/Expand_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat_1 [Concat] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/Expand_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Concat_1 for ONNX node: /encoder/3/downsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Concat_1_output_0 for ONNX tensor: /encoder/3/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat_1 [Concat] outputs: [/encoder/3/downsample/Concat_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3562 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3562 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3562 [Constant] outputs: [onnx::Unsqueeze_4549 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4549 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/downsample/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4549 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_4 for ONNX node: /encoder/3/downsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Constant_17 [Constant] outputs: [/encoder/3/downsample/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3565 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3565 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3565 [Constant] outputs: [onnx::Unsqueeze_4553 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4553 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/downsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4553 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_5 for ONNX node: /encoder/3/downsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3567 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3567 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3567 [Constant] outputs: [onnx::Unsqueeze_4555 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4555 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/downsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4555 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Unsqueeze_6 for ONNX node: /encoder/3/downsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat_2 [Concat] inputs: [/encoder/3/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/downsample/Constant_17_output_0 -> (1)[INT32]], [/encoder/3/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Constant_17_output_0 for ONNX node: /encoder/3/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Concat_2 for ONNX node: /encoder/3/downsample/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Concat_2_output_0 for ONNX tensor: /encoder/3/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Concat_2 [Concat] outputs: [/encoder/3/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Reshape_1 [Reshape] inputs: [/encoder/3/downsample/Concat_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Reshape_1 for ONNX node: /encoder/3/downsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Reshape_1_output_0 for ONNX tensor: /encoder/3/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Reshape_1 [Reshape] outputs: [/encoder/3/downsample/Reshape_1_output_0 -> (-1, 8, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Softmax_9447 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Softmax [Softmax] inputs: [onnx::Softmax_9447 -> (8, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::Softmax_9447 for ONNX node: onnx::Softmax_9447 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Softmax for ONNX node: /encoder/3/downsample/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Softmax_output_0 for ONNX tensor: /encoder/3/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Softmax [Softmax] outputs: [/encoder/3/downsample/Softmax_output_0 -> (8, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul_2 [Mul] inputs: [/encoder/3/downsample/Reshape_1_output_0 -> (-1, 8, -1, 512)[FLOAT]], [/encoder/3/downsample/Softmax_output_0 -> (8, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/Mul_2 for ONNX node: /encoder/3/downsample/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/Mul_2_output_0 for ONNX tensor: /encoder/3/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/Mul_2 [Mul] outputs: [/encoder/3/downsample/Mul_2_output_0 -> (-1, 8, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/downsample/ReduceSum [ReduceSum] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/ReduceSum [ReduceSum] inputs: [/encoder/3/downsample/Mul_2_output_0 -> (-1, 8, -1, 512)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/downsample/ReduceSum for ONNX node: /encoder/3/downsample/ReduceSum [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/downsample/ReduceSum_output_0 for ONNX tensor: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/downsample/ReduceSum [ReduceSum] outputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Shape [Shape] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Shape for ONNX node: /encoder/3/encoder/encoder_pos/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Shape [Shape] outputs: [/encoder/3/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_1 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Gather [Gather] inputs: [/encoder/3/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/3/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Gather for ONNX node: /encoder/3/encoder/encoder_pos/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Gather [Gather] outputs: [/encoder/3/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_2 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Sub [Sub] inputs: [/encoder/3/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/3/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/3/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Sub for ONNX node: /encoder/3/encoder/encoder_pos/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Sub [Sub] outputs: [/encoder/3/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_3 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Add [Add] inputs: [/encoder/3/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/3/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/3/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Add for ONNX node: /encoder/3/encoder/encoder_pos/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Add_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Add [Add] outputs: [/encoder/3/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_4 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Add_1 [Add] inputs: [/encoder/3/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/3/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/3/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Add_1 for ONNX node: /encoder/3/encoder/encoder_pos/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Add_1 [Add] outputs: [/encoder/3/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_5 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/3/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Unsqueeze for ONNX node: /encoder/3/encoder/encoder_pos/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_6 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/3/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/3/encoder/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_7 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_8 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Slice [Slice] inputs: [/encoder/3/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/3/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Constant_output_0 for ONNX node: /encoder/3/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Slice for ONNX node: /encoder/3/encoder/encoder_pos/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Slice [Slice] outputs: [/encoder/3/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Constant_9 [Constant] outputs: [/encoder/3/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/3/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/3/encoder/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9449 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9449 -> (512, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9449 for ONNX node: onnx::MatMul_9449 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias -> (544)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/in_proj/Add for ONNX node: /encoder/3/encoder/0/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice [Slice] inputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Slice for ONNX node: /encoder/3/encoder/0/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice [Slice] outputs: [/encoder/3/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Slice_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/3/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/3/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Slice_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/3/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3616 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3616 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3616 [Constant] outputs: [onnx::Unsqueeze_4610 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4610 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4610 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3618 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3618 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3618 [Constant] outputs: [onnx::Unsqueeze_4612 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4612 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4612 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3623 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3623 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3623 [Constant] outputs: [onnx::Unsqueeze_4619 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4619 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4619 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3625 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3625 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3625 [Constant] outputs: [onnx::Unsqueeze_4621 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4621 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4621 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3631 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3631 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3631 [Constant] outputs: [onnx::Unsqueeze_4629 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4629 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4629 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3633 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3633 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3633 [Constant] outputs: [onnx::Unsqueeze_4631 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4631 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4631 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Transpose for ONNX node: /encoder/3/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Transpose_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Transpose_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/MatMul for ONNX node: /encoder/3/encoder/0/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9456 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9456 -> (48, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9456 for ONNX node: onnx::MatMul_9456 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Mul [Mul] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Mul for ONNX node: /encoder/3/encoder/0/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Mul [Mul] outputs: [/encoder/3/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Sub [Sub] inputs: [/encoder/3/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Sub for ONNX node: /encoder/3/encoder/0/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Sub [Sub] outputs: [/encoder/3/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3650 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3650 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3650 [Constant] outputs: [onnx::Unsqueeze_4652 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4652 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_4652 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Transpose_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/3/encoder/0/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/MatMul_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather_3 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_4 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather_4 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_5 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Gather_5 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/3/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Sub_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Cast for ONNX node: /encoder/3/encoder/0/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast [Cast] outputs: [/encoder/3/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Range [Range] inputs: [/encoder/3/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Range for ONNX node: /encoder/3/encoder/0/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Range [Range] outputs: [/encoder/3/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Cast_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/3/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Range_1 [Range] inputs: [/encoder/3/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Range_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Range_1 [Range] outputs: [/encoder/3/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Mul_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3681 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3681 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3681 [Constant] outputs: [onnx::Unsqueeze_4685 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4685 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4685 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_4 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3684 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3684 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3684 [Constant] outputs: [onnx::Unsqueeze_4688 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4688 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4688 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_5 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Shape_6 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/3/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Expand for ONNX node: /encoder/3/encoder/0/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Expand [Expand] outputs: [/encoder/3/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Tile [Tile] inputs: [/encoder/3/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Tile for ONNX node: /encoder/3/encoder/0/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Tile [Tile] outputs: [/encoder/3/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Add [Add] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Add for ONNX node: /encoder/3/encoder/0/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Add [Add] outputs: [/encoder/3/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3695 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3695 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3695 [Constant] outputs: [onnx::Unsqueeze_4700 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4700 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_4700 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_6 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape_4 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/GatherElements for ONNX node: /encoder/3/encoder/0/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/3/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3700 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3700 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3700 [Constant] outputs: [onnx::Unsqueeze_4705 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4705 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4705 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3702 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3702 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3702 [Constant] outputs: [onnx::Unsqueeze_4707 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4707 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4707 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3704 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3704 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3704 [Constant] outputs: [onnx::Unsqueeze_4709 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4709 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4709 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3706 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3706 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3706 [Constant] outputs: [onnx::Unsqueeze_4711 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4711 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4711 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Concat_7 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/3/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/3/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Reshape_5 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/3/encoder/0/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Add_1 [Add] inputs: [/encoder/3/encoder/0/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Add_1 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Add_1 [Add] outputs: [/encoder/3/encoder/0/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] inputs: [/encoder/Slice_3_output_0 -> (-1, -1)[BOOL]], [/encoder/3/encoder/0/self_attn_weights/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Cast_2 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/3/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Constant_37 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_37 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Constant_37 [Constant] outputs: [/encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Where [Where] inputs: [/encoder/3/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 -> ()[FLOAT]], [/encoder/3/encoder/0/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 for ONNX node: /encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Where for ONNX node: /encoder/3/encoder/0/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Where [Where] outputs: [/encoder/3/encoder/0/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/3/encoder/0/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn_weights/Softmax for ONNX node: /encoder/3/encoder/0/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/3/encoder/0/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9463 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9463 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9463 for ONNX node: onnx::MatMul_9463 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/in_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Sub for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Exp for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Log for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Cast for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Equal for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Where for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Mul for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9464 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [onnx::MatMul_9464 -> (1152, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9464 for ONNX node: onnx::MatMul_9464 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add [Add] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add for ONNX node: /encoder/3/encoder/0/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add [Add] outputs: [/encoder/3/encoder/0/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant [Constant] outputs: [/encoder/3/encoder/0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Slice [Slice] inputs: [/encoder/3/encoder/0/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/Constant_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Slice for ONNX node: /encoder/3/encoder/0/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Slice_output_0 for ONNX tensor: /encoder/3/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Slice [Slice] outputs: [/encoder/3/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9465 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9465 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9465 for ONNX node: onnx::MatMul_9465 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/in_proj/Add for ONNX node: /encoder/3/encoder/0/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape [Shape] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Add [Add] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Add for ONNX node: /encoder/3/encoder/0/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Add [Add] outputs: [/encoder/3/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Div [Div] inputs: [/encoder/3/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Div for ONNX node: /encoder/3/encoder/0/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Div [Div] outputs: [/encoder/3/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul [Mul] inputs: [/encoder/3/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Mul for ONNX node: /encoder/3/encoder/0/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul [Mul] outputs: [/encoder/3/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice [Slice] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Slice for ONNX node: /encoder/3/encoder/0/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice [Slice] outputs: [/encoder/3/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/3/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Mul_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Slice_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/3/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/3/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Mul_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/3/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/3/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Slice_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/3/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/3/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/3/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3770 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3770 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3770 [Constant] outputs: [onnx::Unsqueeze_4778 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4778 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4778 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3772 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3772 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3772 [Constant] outputs: [onnx::Unsqueeze_4780 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4780 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4780 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat [Concat] inputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Concat for ONNX node: /encoder/3/encoder/0/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat [Concat] outputs: [/encoder/3/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Reshape for ONNX node: /encoder/3/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/3/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/3/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Mul_3 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape_3 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather_3 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape_4 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather_4 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/3/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Shape_5 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/3/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/3/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Gather_5 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/3/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3787 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3787 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3787 [Constant] outputs: [onnx::Unsqueeze_4796 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4796 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4796 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3789 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3789 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3789 [Constant] outputs: [onnx::Unsqueeze_4798 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4798 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4798 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3791 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3791 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3791 [Constant] outputs: [onnx::Unsqueeze_4800 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4800 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_4800 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Concat_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/3/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Reshape_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/3/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Transpose for ONNX node: /encoder/3/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/3/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/MatMul for ONNX node: /encoder/3/encoder/0/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/3/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Transpose_1 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3799 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3799 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3799 [Constant] outputs: [onnx::Unsqueeze_4809 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4809 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_4809 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3801 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3801 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3801 [Constant] outputs: [onnx::Unsqueeze_4811 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4811 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_4811 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/3/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Concat_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/3/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Reshape_2 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/3/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/Mul_4 for ONNX node: /encoder/3/encoder/0/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/3/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9469 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9469 -> (384, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9469 for ONNX node: onnx::MatMul_9469 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/nonlin_attention/out_proj/Add for ONNX node: /encoder/3/encoder/0/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_1 [Add] inputs: [/encoder/3/encoder/0/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_1 for ONNX node: /encoder/3/encoder/0/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_1 [Add] outputs: [/encoder/3/encoder/0/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape [Shape] inputs: [/encoder/3/encoder/0/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Shape for ONNX node: /encoder/3/encoder/0/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape [Shape] outputs: [/encoder/3/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant [Constant] outputs: [/encoder/3/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather [Gather] inputs: [/encoder/3/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Constant_output_0 for ONNX node: /encoder/3/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Gather for ONNX node: /encoder/3/encoder/0/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather [Gather] outputs: [/encoder/3/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Shape_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_1 [Gather] inputs: [/encoder/3/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Gather_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_1 [Gather] outputs: [/encoder/3/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_2 [Shape] inputs: [/encoder/3/encoder/0/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Shape_2 for ONNX node: /encoder/3/encoder/0/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_2 [Shape] outputs: [/encoder/3/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_2 [Gather] inputs: [/encoder/3/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Gather_2 for ONNX node: /encoder/3/encoder/0/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_2 [Gather] outputs: [/encoder/3/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9470 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9470 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9470 for ONNX node: onnx::MatMul_9470 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/in_proj/Add for ONNX node: /encoder/3/encoder/0/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3821 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3821 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3821 [Constant] outputs: [onnx::Unsqueeze_4834 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4834 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4834 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3823 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3823 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3823 [Constant] outputs: [onnx::Unsqueeze_4836 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4836 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4836 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3825 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3825 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3825 [Constant] outputs: [onnx::Unsqueeze_4838 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4838 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4838 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Concat [Concat] inputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Concat for ONNX node: /encoder/3/encoder/0/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Concat [Concat] outputs: [/encoder/3/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Reshape [Reshape] inputs: [/encoder/3/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Reshape for ONNX node: /encoder/3/encoder/0/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Reshape [Reshape] outputs: [/encoder/3/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Transpose [Transpose] inputs: [/encoder/3/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Transpose for ONNX node: /encoder/3/encoder/0/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Transpose [Transpose] outputs: [/encoder/3/encoder/0/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_3 [Shape] inputs: [/encoder/3/encoder/0/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Shape_3 for ONNX node: /encoder/3/encoder/0/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Shape_3 [Shape] outputs: [/encoder/3/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_3 [Gather] inputs: [/encoder/3/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Gather_3 for ONNX node: /encoder/3/encoder/0/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Gather_3 [Gather] outputs: [/encoder/3/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/MatMul [MatMul] inputs: [/encoder/3/encoder/0/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/MatMul for ONNX node: /encoder/3/encoder/0/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Transpose_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Mul [Mul] inputs: [/encoder/3/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Mul for ONNX node: /encoder/3/encoder/0/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Mul [Mul] outputs: [/encoder/3/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3837 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3837 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3837 [Constant] outputs: [onnx::Unsqueeze_4851 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4851 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4851 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3839 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3839 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3839 [Constant] outputs: [onnx::Unsqueeze_4853 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4853 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4853 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3841 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3841 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3841 [Constant] outputs: [onnx::Unsqueeze_4855 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4855 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_4855 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/3/encoder/0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Concat_1 [Concat] inputs: [/encoder/3/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Concat_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Concat_1 [Concat] outputs: [/encoder/3/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/Reshape_1 for ONNX node: /encoder/3/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9472 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9472 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9472 for ONNX node: onnx::MatMul_9472 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn1/out_proj/Add for ONNX node: /encoder/3/encoder/0/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn1/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_2 [Add] inputs: [/encoder/3/encoder/0/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_2 for ONNX node: /encoder/3/encoder/0/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_2_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_2 [Add] outputs: [/encoder/3/encoder/0/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9473 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9473 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9473 for ONNX node: onnx::MatMul_9473 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/in_proj/Add for ONNX node: /encoder/3/encoder/0/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Shape [Shape] inputs: [/encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Shape for ONNX node: /encoder/3/encoder/0/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Shape [Shape] outputs: [/encoder/3/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Gather [Gather] inputs: [/encoder/3/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Gather for ONNX node: /encoder/3/encoder/0/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Gather [Gather] outputs: [/encoder/3/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Add [Add] inputs: [/encoder/3/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Add for ONNX node: /encoder/3/encoder/0/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Add [Add] outputs: [/encoder/3/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Div [Div] inputs: [/encoder/3/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Div for ONNX node: /encoder/3/encoder/0/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Div_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Div [Div] outputs: [/encoder/3/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul [Mul] inputs: [/encoder/3/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Mul for ONNX node: /encoder/3/encoder/0/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul [Mul] outputs: [/encoder/3/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Slice [Slice] inputs: [/encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Slice for ONNX node: /encoder/3/encoder/0/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Slice [Slice] outputs: [/encoder/3/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_5 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul_1 [Mul] inputs: [/encoder/3/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Mul_1 for ONNX node: /encoder/3/encoder/0/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul_1 [Mul] outputs: [/encoder/3/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Slice_1 [Slice] inputs: [/encoder/3/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Slice_1 for ONNX node: /encoder/3/encoder/0/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Slice_1 [Slice] outputs: [/encoder/3/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul_2 [Mul] inputs: [/encoder/3/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Mul_2 for ONNX node: /encoder/3/encoder/0/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Mul_2 [Mul] outputs: [/encoder/3/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Transpose [Transpose] inputs: [/encoder/3/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Transpose for ONNX node: /encoder/3/encoder/0/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Transpose [Transpose] outputs: [/encoder/3/encoder/0/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Shape_1 for ONNX node: /encoder/3/encoder/0/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Expand for ONNX node: /encoder/3/encoder/0/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Expand [Expand] outputs: [/encoder/3/encoder/0/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Cast [Cast] inputs: [/encoder/3/encoder/0/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Cast for ONNX node: /encoder/3/encoder/0/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Cast [Cast] outputs: [/encoder/3/encoder/0/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Constant_6 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Where [Where] inputs: [/encoder/3/encoder/0/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/0/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Where for ONNX node: /encoder/3/encoder/0/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Where [Where] outputs: [/encoder/3/encoder/0/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/0/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.0.conv_module1.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/Transpose_1 for ONNX node: /encoder/3/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Sub for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Exp for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Add [Add] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Add for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Log [Log] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Log for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Log [Log] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Cast for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Equal for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Where [Where] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Where for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Where [Where] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Mul for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9474 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9474 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9474 for ONNX node: onnx::MatMul_9474 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_3 [Add] inputs: [/encoder/3/encoder/0/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_3 for ONNX node: /encoder/3/encoder/0/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_3_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_3 [Add] outputs: [/encoder/3/encoder/0/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9475 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9475 -> (512, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9475 for ONNX node: onnx::MatMul_9475 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias -> (1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/in_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Sub for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Exp for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Log for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Cast for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Equal for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Where for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Mul for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9476 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [onnx::MatMul_9476 -> (1536, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9476 for ONNX node: onnx::MatMul_9476 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_4 [Add] inputs: [/encoder/3/encoder/0/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_4 for ONNX node: /encoder/3/encoder/0/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_4_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_4 [Add] outputs: [/encoder/3/encoder/0/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Sub [Sub] inputs: [/encoder/3/encoder/0/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass_mid/Sub for ONNX node: /encoder/3/encoder/0/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Sub [Sub] outputs: [/encoder/3/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Mul [Mul] inputs: [/encoder/3/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass_mid/Mul for ONNX node: /encoder/3/encoder/0/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Mul [Mul] outputs: [/encoder/3/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Add [Add] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass_mid/Add for ONNX node: /encoder/3/encoder/0/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass_mid/Add [Add] outputs: [/encoder/3/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape [Shape] inputs: [/encoder/3/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Shape for ONNX node: /encoder/3/encoder/0/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape [Shape] outputs: [/encoder/3/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant [Constant] outputs: [/encoder/3/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather [Gather] inputs: [/encoder/3/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Constant_output_0 for ONNX node: /encoder/3/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Gather for ONNX node: /encoder/3/encoder/0/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather [Gather] outputs: [/encoder/3/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Shape_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather_1 [Gather] inputs: [/encoder/3/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Gather_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather_1 [Gather] outputs: [/encoder/3/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9477 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9477 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9477 for ONNX node: onnx::MatMul_9477 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/in_proj/Add for ONNX node: /encoder/3/encoder/0/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3923 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3923 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3923 [Constant] outputs: [onnx::Unsqueeze_4943 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4943 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4943 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3925 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3925 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3925 [Constant] outputs: [onnx::Unsqueeze_4945 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4945 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4945 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3927 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3927 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3927 [Constant] outputs: [onnx::Unsqueeze_4947 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4947 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_4947 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Concat [Concat] inputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Concat for ONNX node: /encoder/3/encoder/0/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Concat [Concat] outputs: [/encoder/3/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Reshape [Reshape] inputs: [/encoder/3/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Reshape for ONNX node: /encoder/3/encoder/0/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Reshape [Reshape] outputs: [/encoder/3/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Transpose [Transpose] inputs: [/encoder/3/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Transpose for ONNX node: /encoder/3/encoder/0/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Transpose [Transpose] outputs: [/encoder/3/encoder/0/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape_2 [Shape] inputs: [/encoder/3/encoder/0/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Shape_2 for ONNX node: /encoder/3/encoder/0/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Shape_2 [Shape] outputs: [/encoder/3/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather_2 [Gather] inputs: [/encoder/3/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Gather_2 for ONNX node: /encoder/3/encoder/0/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Gather_2 [Gather] outputs: [/encoder/3/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/MatMul [MatMul] inputs: [/encoder/3/encoder/0/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/0/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/MatMul for ONNX node: /encoder/3/encoder/0/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Transpose_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Mul [Mul] inputs: [/encoder/3/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Mul for ONNX node: /encoder/3/encoder/0/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Mul [Mul] outputs: [/encoder/3/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3939 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3939 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3939 [Constant] outputs: [onnx::Unsqueeze_4960 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4960 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_4960 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3941 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3941 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3941 [Constant] outputs: [onnx::Unsqueeze_4962 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4962 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_4962 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_3943 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_3943 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_3943 [Constant] outputs: [onnx::Unsqueeze_4964 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_4964 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_4964 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/3/encoder/0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Concat_1 [Concat] inputs: [/encoder/3/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Concat_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Concat_1 [Concat] outputs: [/encoder/3/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/Reshape_1 for ONNX node: /encoder/3/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9479 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9479 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9479 for ONNX node: onnx::MatMul_9479 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/self_attn2/out_proj/Add for ONNX node: /encoder/3/encoder/0/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/self_attn2/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_5 [Add] inputs: [/encoder/3/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_5 for ONNX node: /encoder/3/encoder/0/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_5_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_5 [Add] outputs: [/encoder/3/encoder/0/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9480 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9480 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9480 for ONNX node: onnx::MatMul_9480 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/in_proj/Add for ONNX node: /encoder/3/encoder/0/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Shape [Shape] inputs: [/encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Shape for ONNX node: /encoder/3/encoder/0/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Shape [Shape] outputs: [/encoder/3/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Gather [Gather] inputs: [/encoder/3/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Gather for ONNX node: /encoder/3/encoder/0/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Gather [Gather] outputs: [/encoder/3/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Add [Add] inputs: [/encoder/3/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Add for ONNX node: /encoder/3/encoder/0/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Add [Add] outputs: [/encoder/3/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Div [Div] inputs: [/encoder/3/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Div for ONNX node: /encoder/3/encoder/0/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Div_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Div [Div] outputs: [/encoder/3/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul [Mul] inputs: [/encoder/3/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Mul for ONNX node: /encoder/3/encoder/0/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul [Mul] outputs: [/encoder/3/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Slice [Slice] inputs: [/encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Slice for ONNX node: /encoder/3/encoder/0/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Slice [Slice] outputs: [/encoder/3/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_5 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul_1 [Mul] inputs: [/encoder/3/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Mul_1 for ONNX node: /encoder/3/encoder/0/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul_1 [Mul] outputs: [/encoder/3/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Slice_1 [Slice] inputs: [/encoder/3/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Slice_1 for ONNX node: /encoder/3/encoder/0/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Slice_1 [Slice] outputs: [/encoder/3/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul_2 [Mul] inputs: [/encoder/3/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Mul_2 for ONNX node: /encoder/3/encoder/0/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Mul_2 [Mul] outputs: [/encoder/3/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Transpose [Transpose] inputs: [/encoder/3/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Transpose for ONNX node: /encoder/3/encoder/0/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Transpose [Transpose] outputs: [/encoder/3/encoder/0/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Shape_1 [Shape] inputs: [/encoder/3/encoder/0/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Shape_1 for ONNX node: /encoder/3/encoder/0/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Shape_1 [Shape] outputs: [/encoder/3/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Expand for ONNX node: /encoder/3/encoder/0/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Expand [Expand] outputs: [/encoder/3/encoder/0/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Cast [Cast] inputs: [/encoder/3/encoder/0/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Cast for ONNX node: /encoder/3/encoder/0/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Cast [Cast] outputs: [/encoder/3/encoder/0/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Constant_6 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Where [Where] inputs: [/encoder/3/encoder/0/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/0/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Where for ONNX node: /encoder/3/encoder/0/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Where [Where] outputs: [/encoder/3/encoder/0/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/0/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.0.conv_module2.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/Transpose_1 for ONNX node: /encoder/3/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Sub for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Exp for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Add [Add] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Add for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Log [Log] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Log for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Log [Log] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Cast for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Equal for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Where [Where] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Where for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Where [Where] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Mul for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9481 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9481 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9481 for ONNX node: onnx::MatMul_9481 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_6 [Add] inputs: [/encoder/3/encoder/0/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_6 for ONNX node: /encoder/3/encoder/0/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_6_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_6 [Add] outputs: [/encoder/3/encoder/0/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9482 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9482 -> (512, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9482 for ONNX node: onnx::MatMul_9482 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias -> (1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/in_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Sub for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Exp for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Add for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Log for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Cast for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Equal for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Where for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Mul for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9483 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [onnx::MatMul_9483 -> (1920, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9483 for ONNX node: onnx::MatMul_9483 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_7 [Add] inputs: [/encoder/3/encoder/0/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/Add_7 for ONNX node: /encoder/3/encoder/0/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/Add_7_output_0 for ONNX tensor: /encoder/3/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/Add_7 [Add] outputs: [/encoder/3/encoder/0/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Sub [Sub] inputs: [/encoder/3/encoder/0/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.0.norm.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.norm.bias for ONNX node: encoder.encoders.3.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Sub for ONNX node: /encoder/3/encoder/0/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Sub [Sub] outputs: [/encoder/3/encoder/0/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Constant [Constant] outputs: [/encoder/3/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Pow [Pow] inputs: [/encoder/3/encoder/0/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Constant_output_0 for ONNX node: /encoder/3/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Pow for ONNX node: /encoder/3/encoder/0/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Pow_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Pow [Pow] outputs: [/encoder/3/encoder/0/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/ReduceMean [ReduceMean] inputs: [/encoder/3/encoder/0/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/ReduceMean for ONNX node: /encoder/3/encoder/0/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/ReduceMean [ReduceMean] outputs: [/encoder/3/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Constant_1 [Constant] outputs: [/encoder/3/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Pow_1 [Pow] inputs: [/encoder/3/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Constant_1_output_0 for ONNX node: /encoder/3/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Pow_1 for ONNX node: /encoder/3/encoder/0/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Pow_1_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Pow_1 [Pow] outputs: [/encoder/3/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Exp [Exp] inputs: [encoder.encoders.3.encoder.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.norm.log_scale for ONNX node: encoder.encoders.3.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Exp for ONNX node: /encoder/3/encoder/0/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Exp_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Exp [Exp] outputs: [/encoder/3/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Mul [Mul] inputs: [/encoder/3/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Mul for ONNX node: /encoder/3/encoder/0/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Mul [Mul] outputs: [/encoder/3/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Mul_1 [Mul] inputs: [/encoder/3/encoder/0/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/norm/Mul_1 for ONNX node: /encoder/3/encoder/0/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/norm/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/norm/Mul_1 [Mul] outputs: [/encoder/3/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Sub [Sub] inputs: [/encoder/3/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass/Sub for ONNX node: /encoder/3/encoder/0/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass/Sub_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Sub [Sub] outputs: [/encoder/3/encoder/0/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Mul [Mul] inputs: [/encoder/3/encoder/0/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.0.bypass.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass/Mul for ONNX node: /encoder/3/encoder/0/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass/Mul_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Mul [Mul] outputs: [/encoder/3/encoder/0/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/0/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Add [Add] inputs: [/encoder/3/downsample/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/0/bypass/Add for ONNX node: /encoder/3/encoder/0/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/0/bypass/Add_output_0 for ONNX tensor: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/0/bypass/Add [Add] outputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9484 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9484 -> (512, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9484 for ONNX node: onnx::MatMul_9484 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias -> (544)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/in_proj/Add for ONNX node: /encoder/3/encoder/1/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice [Slice] inputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Slice for ONNX node: /encoder/3/encoder/1/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice [Slice] outputs: [/encoder/3/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Slice_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/3/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/3/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Slice_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/3/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4049 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4049 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4049 [Constant] outputs: [onnx::Unsqueeze_5076 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5076 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5076 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4051 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4051 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4051 [Constant] outputs: [onnx::Unsqueeze_5078 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5078 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5078 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4056 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4056 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4056 [Constant] outputs: [onnx::Unsqueeze_5085 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5085 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5085 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4058 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4058 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4058 [Constant] outputs: [onnx::Unsqueeze_5087 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5087 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5087 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4064 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4064 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4064 [Constant] outputs: [onnx::Unsqueeze_5095 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5095 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5095 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4066 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4066 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4066 [Constant] outputs: [onnx::Unsqueeze_5097 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5097 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5097 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Transpose for ONNX node: /encoder/3/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Transpose_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Transpose_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/MatMul for ONNX node: /encoder/3/encoder/1/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9491 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9491 -> (48, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9491 for ONNX node: onnx::MatMul_9491 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Mul [Mul] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Mul for ONNX node: /encoder/3/encoder/1/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Mul [Mul] outputs: [/encoder/3/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Sub [Sub] inputs: [/encoder/3/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Sub for ONNX node: /encoder/3/encoder/1/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Sub [Sub] outputs: [/encoder/3/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4083 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4083 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4083 [Constant] outputs: [onnx::Unsqueeze_5118 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5118 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_5118 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Transpose_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/3/encoder/1/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/MatMul_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather_3 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_4 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather_4 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_5 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Gather_5 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/3/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Sub_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast [Cast] inputs: [/encoder/3/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Cast for ONNX node: /encoder/3/encoder/1/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast [Cast] outputs: [/encoder/3/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Range [Range] inputs: [/encoder/3/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Range for ONNX node: /encoder/3/encoder/1/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Range [Range] outputs: [/encoder/3/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Cast_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/3/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Range_1 [Range] inputs: [/encoder/3/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Range_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Range_1 [Range] outputs: [/encoder/3/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Mul_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4114 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4114 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4114 [Constant] outputs: [onnx::Unsqueeze_5151 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5151 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5151 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_4 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4117 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4117 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4117 [Constant] outputs: [onnx::Unsqueeze_5154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5154 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_5 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Shape_6 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/3/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Expand [Expand] inputs: [/encoder/3/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Expand for ONNX node: /encoder/3/encoder/1/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Expand [Expand] outputs: [/encoder/3/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Tile [Tile] inputs: [/encoder/3/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Tile for ONNX node: /encoder/3/encoder/1/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Tile [Tile] outputs: [/encoder/3/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Add [Add] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Add for ONNX node: /encoder/3/encoder/1/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Add [Add] outputs: [/encoder/3/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4128 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4128 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4128 [Constant] outputs: [onnx::Unsqueeze_5166 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5166 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_5166 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_6 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape_4 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/GatherElements for ONNX node: /encoder/3/encoder/1/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/3/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4133 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4133 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4133 [Constant] outputs: [onnx::Unsqueeze_5171 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5171 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5171 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4135 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4135 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4135 [Constant] outputs: [onnx::Unsqueeze_5173 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5173 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5173 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4137 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4137 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4137 [Constant] outputs: [onnx::Unsqueeze_5175 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5175 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5175 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4139 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4139 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4139 [Constant] outputs: [onnx::Unsqueeze_5177 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5177 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5177 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Concat_7 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/3/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/3/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Reshape_5 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/3/encoder/1/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Add_1 [Add] inputs: [/encoder/3/encoder/1/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Add_1 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Add_1 [Add] outputs: [/encoder/3/encoder/1/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Cast_2 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/3/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Where [Where] inputs: [/encoder/3/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/3/encoder/1/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Where for ONNX node: /encoder/3/encoder/1/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Where [Where] outputs: [/encoder/3/encoder/1/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/3/encoder/1/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn_weights/Softmax for ONNX node: /encoder/3/encoder/1/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/3/encoder/1/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9498 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9498 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9498 for ONNX node: onnx::MatMul_9498 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/in_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Sub for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Exp for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Log for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Cast for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Equal for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Where for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Mul for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9499 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [onnx::MatMul_9499 -> (1152, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9499 for ONNX node: onnx::MatMul_9499 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add [Add] inputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add for ONNX node: /encoder/3/encoder/1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add [Add] outputs: [/encoder/3/encoder/1/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant [Constant] outputs: [/encoder/3/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Slice [Slice] inputs: [/encoder/3/encoder/1/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Slice for ONNX node: /encoder/3/encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Slice_output_0 for ONNX tensor: /encoder/3/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Slice [Slice] outputs: [/encoder/3/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9500 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9500 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9500 for ONNX node: onnx::MatMul_9500 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/in_proj/Add for ONNX node: /encoder/3/encoder/1/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape [Shape] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Add [Add] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Add for ONNX node: /encoder/3/encoder/1/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Add [Add] outputs: [/encoder/3/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Div [Div] inputs: [/encoder/3/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Div for ONNX node: /encoder/3/encoder/1/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Div [Div] outputs: [/encoder/3/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul [Mul] inputs: [/encoder/3/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Mul for ONNX node: /encoder/3/encoder/1/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul [Mul] outputs: [/encoder/3/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice [Slice] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Slice for ONNX node: /encoder/3/encoder/1/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice [Slice] outputs: [/encoder/3/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/3/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Mul_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Slice_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/3/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/3/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Mul_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/3/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/3/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Slice_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/3/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/3/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/3/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4201 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4201 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4201 [Constant] outputs: [onnx::Unsqueeze_5242 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5242 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5242 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4203 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4203 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4203 [Constant] outputs: [onnx::Unsqueeze_5244 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5244 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5244 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat [Concat] inputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Concat for ONNX node: /encoder/3/encoder/1/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat [Concat] outputs: [/encoder/3/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Reshape for ONNX node: /encoder/3/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/3/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/3/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Mul_3 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape_3 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather_3 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape_4 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather_4 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/3/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Shape_5 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/3/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/3/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Gather_5 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/3/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4218 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4218 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4218 [Constant] outputs: [onnx::Unsqueeze_5260 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5260 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5260 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4220 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4220 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4220 [Constant] outputs: [onnx::Unsqueeze_5262 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5262 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5262 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4222 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4222 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4222 [Constant] outputs: [onnx::Unsqueeze_5264 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5264 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_5264 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Concat_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/3/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Reshape_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/3/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Transpose for ONNX node: /encoder/3/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/3/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/MatMul for ONNX node: /encoder/3/encoder/1/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/3/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Transpose_1 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4230 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4230 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4230 [Constant] outputs: [onnx::Unsqueeze_5273 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5273 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5273 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4232 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4232 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4232 [Constant] outputs: [onnx::Unsqueeze_5275 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5275 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5275 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/3/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Concat_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/3/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Reshape_2 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/3/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/Mul_4 for ONNX node: /encoder/3/encoder/1/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/3/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9504 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9504 -> (384, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9504 for ONNX node: onnx::MatMul_9504 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/nonlin_attention/out_proj/Add for ONNX node: /encoder/3/encoder/1/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_1 [Add] inputs: [/encoder/3/encoder/1/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_1 for ONNX node: /encoder/3/encoder/1/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_1 [Add] outputs: [/encoder/3/encoder/1/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape [Shape] inputs: [/encoder/3/encoder/1/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Shape for ONNX node: /encoder/3/encoder/1/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape [Shape] outputs: [/encoder/3/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant [Constant] outputs: [/encoder/3/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather [Gather] inputs: [/encoder/3/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Constant_output_0 for ONNX node: /encoder/3/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Gather for ONNX node: /encoder/3/encoder/1/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather [Gather] outputs: [/encoder/3/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Shape_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_1 [Gather] inputs: [/encoder/3/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Gather_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_1 [Gather] outputs: [/encoder/3/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_2 [Shape] inputs: [/encoder/3/encoder/1/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Shape_2 for ONNX node: /encoder/3/encoder/1/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_2 [Shape] outputs: [/encoder/3/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_2 [Gather] inputs: [/encoder/3/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Gather_2 for ONNX node: /encoder/3/encoder/1/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_2 [Gather] outputs: [/encoder/3/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9505 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9505 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9505 for ONNX node: onnx::MatMul_9505 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/in_proj/Add for ONNX node: /encoder/3/encoder/1/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4252 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4252 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4252 [Constant] outputs: [onnx::Unsqueeze_5298 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5298 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5298 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4254 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4254 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4254 [Constant] outputs: [onnx::Unsqueeze_5300 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5300 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5300 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4256 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4256 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4256 [Constant] outputs: [onnx::Unsqueeze_5302 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5302 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5302 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Concat [Concat] inputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Concat for ONNX node: /encoder/3/encoder/1/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Concat [Concat] outputs: [/encoder/3/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Reshape [Reshape] inputs: [/encoder/3/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Reshape for ONNX node: /encoder/3/encoder/1/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Reshape [Reshape] outputs: [/encoder/3/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Transpose [Transpose] inputs: [/encoder/3/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Transpose for ONNX node: /encoder/3/encoder/1/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Transpose [Transpose] outputs: [/encoder/3/encoder/1/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_3 [Shape] inputs: [/encoder/3/encoder/1/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Shape_3 for ONNX node: /encoder/3/encoder/1/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Shape_3 [Shape] outputs: [/encoder/3/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_3 [Gather] inputs: [/encoder/3/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Gather_3 for ONNX node: /encoder/3/encoder/1/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Gather_3 [Gather] outputs: [/encoder/3/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/MatMul [MatMul] inputs: [/encoder/3/encoder/1/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/MatMul for ONNX node: /encoder/3/encoder/1/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Transpose_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Mul [Mul] inputs: [/encoder/3/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Mul for ONNX node: /encoder/3/encoder/1/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Mul [Mul] outputs: [/encoder/3/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4268 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4268 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4268 [Constant] outputs: [onnx::Unsqueeze_5315 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5315 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5315 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4270 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4270 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4270 [Constant] outputs: [onnx::Unsqueeze_5317 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5317 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5317 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4272 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4272 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4272 [Constant] outputs: [onnx::Unsqueeze_5319 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5319 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_5319 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/3/encoder/1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Concat_1 [Concat] inputs: [/encoder/3/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Concat_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Concat_1 [Concat] outputs: [/encoder/3/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/Reshape_1 for ONNX node: /encoder/3/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9507 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9507 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9507 for ONNX node: onnx::MatMul_9507 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn1/out_proj/Add for ONNX node: /encoder/3/encoder/1/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn1/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_2 [Add] inputs: [/encoder/3/encoder/1/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_2 for ONNX node: /encoder/3/encoder/1/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_2_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_2 [Add] outputs: [/encoder/3/encoder/1/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9508 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9508 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9508 for ONNX node: onnx::MatMul_9508 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/in_proj/Add for ONNX node: /encoder/3/encoder/1/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Shape [Shape] inputs: [/encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Shape for ONNX node: /encoder/3/encoder/1/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Shape [Shape] outputs: [/encoder/3/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Gather [Gather] inputs: [/encoder/3/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Gather for ONNX node: /encoder/3/encoder/1/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Gather [Gather] outputs: [/encoder/3/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Add [Add] inputs: [/encoder/3/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Add for ONNX node: /encoder/3/encoder/1/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Add [Add] outputs: [/encoder/3/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Div [Div] inputs: [/encoder/3/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Div for ONNX node: /encoder/3/encoder/1/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Div_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Div [Div] outputs: [/encoder/3/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul [Mul] inputs: [/encoder/3/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Mul for ONNX node: /encoder/3/encoder/1/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul [Mul] outputs: [/encoder/3/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Slice [Slice] inputs: [/encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Slice for ONNX node: /encoder/3/encoder/1/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Slice [Slice] outputs: [/encoder/3/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_5 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul_1 [Mul] inputs: [/encoder/3/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Mul_1 for ONNX node: /encoder/3/encoder/1/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul_1 [Mul] outputs: [/encoder/3/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Slice_1 [Slice] inputs: [/encoder/3/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Slice_1 for ONNX node: /encoder/3/encoder/1/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Slice_1 [Slice] outputs: [/encoder/3/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul_2 [Mul] inputs: [/encoder/3/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Mul_2 for ONNX node: /encoder/3/encoder/1/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Mul_2 [Mul] outputs: [/encoder/3/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Transpose [Transpose] inputs: [/encoder/3/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Transpose for ONNX node: /encoder/3/encoder/1/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Transpose [Transpose] outputs: [/encoder/3/encoder/1/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Shape_1 for ONNX node: /encoder/3/encoder/1/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Expand for ONNX node: /encoder/3/encoder/1/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Expand [Expand] outputs: [/encoder/3/encoder/1/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Cast [Cast] inputs: [/encoder/3/encoder/1/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Cast for ONNX node: /encoder/3/encoder/1/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Cast [Cast] outputs: [/encoder/3/encoder/1/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Constant_6 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Where [Where] inputs: [/encoder/3/encoder/1/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/1/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Where for ONNX node: /encoder/3/encoder/1/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Where [Where] outputs: [/encoder/3/encoder/1/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/1/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.1.conv_module1.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/Transpose_1 for ONNX node: /encoder/3/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Sub for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Exp for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Add [Add] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Add for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Log [Log] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Log for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Log [Log] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Cast for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Equal for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Where [Where] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Where for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Where [Where] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Mul for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9509 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9509 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9509 for ONNX node: onnx::MatMul_9509 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_3 [Add] inputs: [/encoder/3/encoder/1/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_3 for ONNX node: /encoder/3/encoder/1/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_3_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_3 [Add] outputs: [/encoder/3/encoder/1/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9510 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9510 -> (512, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9510 for ONNX node: onnx::MatMul_9510 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias -> (1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/in_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Sub for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Exp for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Log for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Cast for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Equal for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Where for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Mul for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9511 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [onnx::MatMul_9511 -> (1536, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9511 for ONNX node: onnx::MatMul_9511 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_4 [Add] inputs: [/encoder/3/encoder/1/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_4 for ONNX node: /encoder/3/encoder/1/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_4_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_4 [Add] outputs: [/encoder/3/encoder/1/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Sub [Sub] inputs: [/encoder/3/encoder/1/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass_mid/Sub for ONNX node: /encoder/3/encoder/1/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Sub [Sub] outputs: [/encoder/3/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Mul [Mul] inputs: [/encoder/3/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass_mid/Mul for ONNX node: /encoder/3/encoder/1/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Mul [Mul] outputs: [/encoder/3/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Add [Add] inputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass_mid/Add for ONNX node: /encoder/3/encoder/1/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass_mid/Add [Add] outputs: [/encoder/3/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape [Shape] inputs: [/encoder/3/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Shape for ONNX node: /encoder/3/encoder/1/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape [Shape] outputs: [/encoder/3/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant [Constant] outputs: [/encoder/3/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather [Gather] inputs: [/encoder/3/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Constant_output_0 for ONNX node: /encoder/3/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Gather for ONNX node: /encoder/3/encoder/1/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather [Gather] outputs: [/encoder/3/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Shape_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather_1 [Gather] inputs: [/encoder/3/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Gather_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather_1 [Gather] outputs: [/encoder/3/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9512 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9512 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9512 for ONNX node: onnx::MatMul_9512 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/in_proj/Add for ONNX node: /encoder/3/encoder/1/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4354 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4354 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4354 [Constant] outputs: [onnx::Unsqueeze_5407 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5407 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5407 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4356 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4356 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4356 [Constant] outputs: [onnx::Unsqueeze_5409 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5409 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5409 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4358 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4358 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4358 [Constant] outputs: [onnx::Unsqueeze_5411 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5411 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5411 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Concat [Concat] inputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Concat for ONNX node: /encoder/3/encoder/1/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Concat [Concat] outputs: [/encoder/3/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Reshape [Reshape] inputs: [/encoder/3/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Reshape for ONNX node: /encoder/3/encoder/1/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Reshape [Reshape] outputs: [/encoder/3/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Transpose [Transpose] inputs: [/encoder/3/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Transpose for ONNX node: /encoder/3/encoder/1/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Transpose [Transpose] outputs: [/encoder/3/encoder/1/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape_2 [Shape] inputs: [/encoder/3/encoder/1/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Shape_2 for ONNX node: /encoder/3/encoder/1/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Shape_2 [Shape] outputs: [/encoder/3/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather_2 [Gather] inputs: [/encoder/3/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Gather_2 for ONNX node: /encoder/3/encoder/1/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Gather_2 [Gather] outputs: [/encoder/3/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/MatMul [MatMul] inputs: [/encoder/3/encoder/1/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/1/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/MatMul for ONNX node: /encoder/3/encoder/1/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Transpose_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Mul [Mul] inputs: [/encoder/3/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Mul for ONNX node: /encoder/3/encoder/1/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Mul [Mul] outputs: [/encoder/3/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4370 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4370 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4370 [Constant] outputs: [onnx::Unsqueeze_5424 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5424 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5424 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4372 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4372 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4372 [Constant] outputs: [onnx::Unsqueeze_5426 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5426 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5426 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4374 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4374 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4374 [Constant] outputs: [onnx::Unsqueeze_5428 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5428 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_5428 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/3/encoder/1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Concat_1 [Concat] inputs: [/encoder/3/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Concat_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Concat_1 [Concat] outputs: [/encoder/3/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/Reshape_1 for ONNX node: /encoder/3/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9514 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9514 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9514 for ONNX node: onnx::MatMul_9514 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/self_attn2/out_proj/Add for ONNX node: /encoder/3/encoder/1/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/self_attn2/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_5 [Add] inputs: [/encoder/3/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_5 for ONNX node: /encoder/3/encoder/1/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_5_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_5 [Add] outputs: [/encoder/3/encoder/1/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9515 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9515 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9515 for ONNX node: onnx::MatMul_9515 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/in_proj/Add for ONNX node: /encoder/3/encoder/1/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Shape [Shape] inputs: [/encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Shape for ONNX node: /encoder/3/encoder/1/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Shape [Shape] outputs: [/encoder/3/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Gather [Gather] inputs: [/encoder/3/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Gather for ONNX node: /encoder/3/encoder/1/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Gather [Gather] outputs: [/encoder/3/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Add [Add] inputs: [/encoder/3/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Add for ONNX node: /encoder/3/encoder/1/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Add [Add] outputs: [/encoder/3/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Div [Div] inputs: [/encoder/3/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Div for ONNX node: /encoder/3/encoder/1/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Div_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Div [Div] outputs: [/encoder/3/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul [Mul] inputs: [/encoder/3/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Mul for ONNX node: /encoder/3/encoder/1/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul [Mul] outputs: [/encoder/3/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Slice [Slice] inputs: [/encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Slice for ONNX node: /encoder/3/encoder/1/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Slice [Slice] outputs: [/encoder/3/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_5 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul_1 [Mul] inputs: [/encoder/3/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Mul_1 for ONNX node: /encoder/3/encoder/1/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul_1 [Mul] outputs: [/encoder/3/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Slice_1 [Slice] inputs: [/encoder/3/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Slice_1 for ONNX node: /encoder/3/encoder/1/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Slice_1 [Slice] outputs: [/encoder/3/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul_2 [Mul] inputs: [/encoder/3/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Mul_2 for ONNX node: /encoder/3/encoder/1/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Mul_2 [Mul] outputs: [/encoder/3/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Transpose [Transpose] inputs: [/encoder/3/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Transpose for ONNX node: /encoder/3/encoder/1/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Transpose [Transpose] outputs: [/encoder/3/encoder/1/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Shape_1 [Shape] inputs: [/encoder/3/encoder/1/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Shape_1 for ONNX node: /encoder/3/encoder/1/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Shape_1 [Shape] outputs: [/encoder/3/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Expand for ONNX node: /encoder/3/encoder/1/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Expand [Expand] outputs: [/encoder/3/encoder/1/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Cast [Cast] inputs: [/encoder/3/encoder/1/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Cast for ONNX node: /encoder/3/encoder/1/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Cast [Cast] outputs: [/encoder/3/encoder/1/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Constant_6 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Where [Where] inputs: [/encoder/3/encoder/1/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/1/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Where for ONNX node: /encoder/3/encoder/1/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Where [Where] outputs: [/encoder/3/encoder/1/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/1/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.1.conv_module2.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/Transpose_1 for ONNX node: /encoder/3/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Sub for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Exp for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Add [Add] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Add for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Log [Log] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Log for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Log [Log] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Cast for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Equal for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Where [Where] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Where for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Where [Where] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Mul for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9516 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9516 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9516 for ONNX node: onnx::MatMul_9516 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_6 [Add] inputs: [/encoder/3/encoder/1/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_6 for ONNX node: /encoder/3/encoder/1/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_6_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_6 [Add] outputs: [/encoder/3/encoder/1/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9517 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9517 -> (512, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9517 for ONNX node: onnx::MatMul_9517 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias -> (1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/in_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Sub for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Exp for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Add for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Log for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Cast for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Equal for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Where for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Mul for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9518 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [onnx::MatMul_9518 -> (1920, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9518 for ONNX node: onnx::MatMul_9518 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_7 [Add] inputs: [/encoder/3/encoder/1/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/Add_7 for ONNX node: /encoder/3/encoder/1/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/Add_7_output_0 for ONNX tensor: /encoder/3/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/Add_7 [Add] outputs: [/encoder/3/encoder/1/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Sub [Sub] inputs: [/encoder/3/encoder/1/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.1.norm.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.norm.bias for ONNX node: encoder.encoders.3.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Sub for ONNX node: /encoder/3/encoder/1/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Sub [Sub] outputs: [/encoder/3/encoder/1/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Constant [Constant] outputs: [/encoder/3/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Pow [Pow] inputs: [/encoder/3/encoder/1/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Constant_output_0 for ONNX node: /encoder/3/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Pow for ONNX node: /encoder/3/encoder/1/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Pow_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Pow [Pow] outputs: [/encoder/3/encoder/1/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/ReduceMean [ReduceMean] inputs: [/encoder/3/encoder/1/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/ReduceMean for ONNX node: /encoder/3/encoder/1/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/ReduceMean [ReduceMean] outputs: [/encoder/3/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Constant_1 [Constant] outputs: [/encoder/3/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Pow_1 [Pow] inputs: [/encoder/3/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Constant_1_output_0 for ONNX node: /encoder/3/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Pow_1 for ONNX node: /encoder/3/encoder/1/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Pow_1_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Pow_1 [Pow] outputs: [/encoder/3/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Exp [Exp] inputs: [encoder.encoders.3.encoder.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.norm.log_scale for ONNX node: encoder.encoders.3.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Exp for ONNX node: /encoder/3/encoder/1/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Exp_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Exp [Exp] outputs: [/encoder/3/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Mul [Mul] inputs: [/encoder/3/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Mul for ONNX node: /encoder/3/encoder/1/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Mul [Mul] outputs: [/encoder/3/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Mul_1 [Mul] inputs: [/encoder/3/encoder/1/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/norm/Mul_1 for ONNX node: /encoder/3/encoder/1/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/norm/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/norm/Mul_1 [Mul] outputs: [/encoder/3/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Sub [Sub] inputs: [/encoder/3/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass/Sub for ONNX node: /encoder/3/encoder/1/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass/Sub_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Sub [Sub] outputs: [/encoder/3/encoder/1/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Mul [Mul] inputs: [/encoder/3/encoder/1/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.1.bypass.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass/Mul for ONNX node: /encoder/3/encoder/1/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass/Mul_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Mul [Mul] outputs: [/encoder/3/encoder/1/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/1/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Add [Add] inputs: [/encoder/3/encoder/0/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/1/bypass/Add for ONNX node: /encoder/3/encoder/1/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/1/bypass/Add_output_0 for ONNX tensor: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/1/bypass/Add [Add] outputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9519 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9519 -> (512, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9519 for ONNX node: onnx::MatMul_9519 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias -> (544)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/in_proj/Add for ONNX node: /encoder/3/encoder/2/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice [Slice] inputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Slice for ONNX node: /encoder/3/encoder/2/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice [Slice] outputs: [/encoder/3/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Slice_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/3/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/3/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Slice_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/3/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4480 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4480 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4480 [Constant] outputs: [onnx::Unsqueeze_5540 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5540 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5540 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4482 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4482 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4482 [Constant] outputs: [onnx::Unsqueeze_5542 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5542 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5542 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4487 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4487 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4487 [Constant] outputs: [onnx::Unsqueeze_5549 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5549 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5549 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4489 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4489 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4489 [Constant] outputs: [onnx::Unsqueeze_5551 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5551 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5551 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4495 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4495 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4495 [Constant] outputs: [onnx::Unsqueeze_5559 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5559 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5559 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4497 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4497 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4497 [Constant] outputs: [onnx::Unsqueeze_5561 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5561 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5561 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose [Transpose] inputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Transpose for ONNX node: /encoder/3/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose [Transpose] outputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Transpose_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Transpose_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/MatMul [MatMul] inputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/MatMul for ONNX node: /encoder/3/encoder/2/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9526 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9526 -> (48, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9526 for ONNX node: onnx::MatMul_9526 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Mul [Mul] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Mul for ONNX node: /encoder/3/encoder/2/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Mul [Mul] outputs: [/encoder/3/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Sub [Sub] inputs: [/encoder/3/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Sub for ONNX node: /encoder/3/encoder/2/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Sub [Sub] outputs: [/encoder/3/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4514 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4514 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4514 [Constant] outputs: [onnx::Unsqueeze_5582 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5582 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_5582 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Transpose_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/3/encoder/2/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/MatMul_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather_3 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_4 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather_4 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_5 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Gather_5 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/3/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Sub_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast [Cast] inputs: [/encoder/3/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Cast for ONNX node: /encoder/3/encoder/2/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast [Cast] outputs: [/encoder/3/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Range [Range] inputs: [/encoder/3/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Range for ONNX node: /encoder/3/encoder/2/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Range [Range] outputs: [/encoder/3/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Cast_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/3/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Range_1 [Range] inputs: [/encoder/3/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Range_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Range_1 [Range] outputs: [/encoder/3/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Mul_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4545 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4545 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4545 [Constant] outputs: [onnx::Unsqueeze_5615 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5615 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5615 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_4 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4548 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4548 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4548 [Constant] outputs: [onnx::Unsqueeze_5618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5618 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_5 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Shape_6 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/3/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Expand [Expand] inputs: [/encoder/3/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Expand for ONNX node: /encoder/3/encoder/2/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Expand [Expand] outputs: [/encoder/3/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Tile [Tile] inputs: [/encoder/3/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Tile for ONNX node: /encoder/3/encoder/2/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Tile [Tile] outputs: [/encoder/3/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Add [Add] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Add for ONNX node: /encoder/3/encoder/2/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Add [Add] outputs: [/encoder/3/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4559 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4559 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4559 [Constant] outputs: [onnx::Unsqueeze_5630 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5630 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_5630 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_6 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape_4 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/GatherElements for ONNX node: /encoder/3/encoder/2/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/3/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4564 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4564 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4564 [Constant] outputs: [onnx::Unsqueeze_5635 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5635 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5635 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4566 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4566 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4566 [Constant] outputs: [onnx::Unsqueeze_5637 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5637 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5637 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4568 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4568 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4568 [Constant] outputs: [onnx::Unsqueeze_5639 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5639 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5639 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4570 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4570 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4570 [Constant] outputs: [onnx::Unsqueeze_5641 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5641 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5641 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Concat_7 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/3/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/3/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Reshape_5 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/3/encoder/2/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Add_1 [Add] inputs: [/encoder/3/encoder/2/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Add_1 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Add_1 [Add] outputs: [/encoder/3/encoder/2/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Cast_2 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/3/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Where [Where] inputs: [/encoder/3/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/3/encoder/2/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Where for ONNX node: /encoder/3/encoder/2/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Where [Where] outputs: [/encoder/3/encoder/2/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Softmax [Softmax] inputs: [/encoder/3/encoder/2/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn_weights/Softmax for ONNX node: /encoder/3/encoder/2/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn_weights/Softmax [Softmax] outputs: [/encoder/3/encoder/2/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9533 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9533 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9533 for ONNX node: onnx::MatMul_9533 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/in_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Sub for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Exp for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Add [Add] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Log [Log] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Log for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Log [Log] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Cast for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Equal for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Where [Where] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Where for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Where [Where] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Mul for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9534 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [onnx::MatMul_9534 -> (1152, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9534 for ONNX node: onnx::MatMul_9534 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add [Add] inputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add for ONNX node: /encoder/3/encoder/2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add [Add] outputs: [/encoder/3/encoder/2/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant [Constant] outputs: [/encoder/3/encoder/2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Slice [Slice] inputs: [/encoder/3/encoder/2/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/Constant_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Slice for ONNX node: /encoder/3/encoder/2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Slice_output_0 for ONNX tensor: /encoder/3/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Slice [Slice] outputs: [/encoder/3/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9535 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9535 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9535 for ONNX node: onnx::MatMul_9535 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/in_proj/Add for ONNX node: /encoder/3/encoder/2/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape [Shape] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Add [Add] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Add for ONNX node: /encoder/3/encoder/2/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Add [Add] outputs: [/encoder/3/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Div [Div] inputs: [/encoder/3/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Div for ONNX node: /encoder/3/encoder/2/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Div [Div] outputs: [/encoder/3/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul [Mul] inputs: [/encoder/3/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Mul for ONNX node: /encoder/3/encoder/2/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul [Mul] outputs: [/encoder/3/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice [Slice] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Slice for ONNX node: /encoder/3/encoder/2/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice [Slice] outputs: [/encoder/3/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/3/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Mul_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Slice_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/3/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/3/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Mul_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/3/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/3/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Slice_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/3/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/3/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh for ONNX node: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/3/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4632 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4632 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4632 [Constant] outputs: [onnx::Unsqueeze_5706 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5706 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5706 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4634 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4634 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4634 [Constant] outputs: [onnx::Unsqueeze_5708 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5708 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5708 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat [Concat] inputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Concat for ONNX node: /encoder/3/encoder/2/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat [Concat] outputs: [/encoder/3/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape [Reshape] inputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Reshape for ONNX node: /encoder/3/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape [Reshape] outputs: [/encoder/3/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/3/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Mul_3 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape_3 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather_3 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape_4 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather_4 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/3/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Shape_5 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/3/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/3/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Gather_5 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/3/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4649 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4649 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4649 [Constant] outputs: [onnx::Unsqueeze_5724 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5724 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5724 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4651 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4651 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4651 [Constant] outputs: [onnx::Unsqueeze_5726 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5726 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5726 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4653 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4653 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4653 [Constant] outputs: [onnx::Unsqueeze_5728 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5728 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_5728 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Concat_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/3/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Reshape_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Transpose [Transpose] inputs: [/encoder/3/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Transpose for ONNX node: /encoder/3/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Transpose [Transpose] outputs: [/encoder/3/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/MatMul for ONNX node: /encoder/3/encoder/2/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/MatMul [MatMul] outputs: [/encoder/3/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Transpose_1 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4661 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4661 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4661 [Constant] outputs: [onnx::Unsqueeze_5737 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5737 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_5737 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4663 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4663 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4663 [Constant] outputs: [onnx::Unsqueeze_5739 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5739 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_5739 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/3/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Concat_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/3/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Reshape_2 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/3/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/Mul_4 for ONNX node: /encoder/3/encoder/2/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/3/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9539 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9539 -> (384, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9539 for ONNX node: onnx::MatMul_9539 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/nonlin_attention/out_proj/Add for ONNX node: /encoder/3/encoder/2/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_1 [Add] inputs: [/encoder/3/encoder/2/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_1 for ONNX node: /encoder/3/encoder/2/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_1 [Add] outputs: [/encoder/3/encoder/2/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape [Shape] inputs: [/encoder/3/encoder/2/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Shape for ONNX node: /encoder/3/encoder/2/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape [Shape] outputs: [/encoder/3/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant [Constant] outputs: [/encoder/3/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather [Gather] inputs: [/encoder/3/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Constant_output_0 for ONNX node: /encoder/3/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Gather for ONNX node: /encoder/3/encoder/2/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather [Gather] outputs: [/encoder/3/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Shape_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_1 [Gather] inputs: [/encoder/3/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Gather_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_1 [Gather] outputs: [/encoder/3/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_2 [Shape] inputs: [/encoder/3/encoder/2/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Shape_2 for ONNX node: /encoder/3/encoder/2/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_2 [Shape] outputs: [/encoder/3/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_2 [Gather] inputs: [/encoder/3/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Gather_2 for ONNX node: /encoder/3/encoder/2/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_2 [Gather] outputs: [/encoder/3/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9540 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9540 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9540 for ONNX node: onnx::MatMul_9540 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/in_proj/Add for ONNX node: /encoder/3/encoder/2/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4683 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4683 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4683 [Constant] outputs: [onnx::Unsqueeze_5762 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5762 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5762 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4685 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4685 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4685 [Constant] outputs: [onnx::Unsqueeze_5764 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5764 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5764 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4687 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4687 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4687 [Constant] outputs: [onnx::Unsqueeze_5766 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5766 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5766 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze_2 for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Concat [Concat] inputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Concat for ONNX node: /encoder/3/encoder/2/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Concat_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Concat [Concat] outputs: [/encoder/3/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Reshape [Reshape] inputs: [/encoder/3/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Reshape for ONNX node: /encoder/3/encoder/2/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Reshape [Reshape] outputs: [/encoder/3/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Transpose [Transpose] inputs: [/encoder/3/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Transpose for ONNX node: /encoder/3/encoder/2/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Transpose [Transpose] outputs: [/encoder/3/encoder/2/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_3 [Shape] inputs: [/encoder/3/encoder/2/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Shape_3 for ONNX node: /encoder/3/encoder/2/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Shape_3 [Shape] outputs: [/encoder/3/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_3 [Gather] inputs: [/encoder/3/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Gather_3 for ONNX node: /encoder/3/encoder/2/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Gather_3 [Gather] outputs: [/encoder/3/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/MatMul [MatMul] inputs: [/encoder/3/encoder/2/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/MatMul for ONNX node: /encoder/3/encoder/2/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Transpose_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Mul [Mul] inputs: [/encoder/3/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Mul for ONNX node: /encoder/3/encoder/2/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Mul [Mul] outputs: [/encoder/3/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4699 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4699 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4699 [Constant] outputs: [onnx::Unsqueeze_5779 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5779 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5779 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze_3 for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4701 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4701 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4701 [Constant] outputs: [onnx::Unsqueeze_5781 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5781 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5781 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze_4 for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4703 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4703 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4703 [Constant] outputs: [onnx::Unsqueeze_5783 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5783 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_5783 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Unsqueeze_5 for ONNX node: /encoder/3/encoder/2/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Concat_1 [Concat] inputs: [/encoder/3/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Concat_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Concat_1 [Concat] outputs: [/encoder/3/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/Reshape_1 for ONNX node: /encoder/3/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9542 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9542 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9542 for ONNX node: onnx::MatMul_9542 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn1/out_proj/Add for ONNX node: /encoder/3/encoder/2/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn1/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_2 [Add] inputs: [/encoder/3/encoder/2/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_2 for ONNX node: /encoder/3/encoder/2/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_2_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_2 [Add] outputs: [/encoder/3/encoder/2/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9543 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9543 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9543 for ONNX node: onnx::MatMul_9543 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/in_proj/Add for ONNX node: /encoder/3/encoder/2/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Shape [Shape] inputs: [/encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Shape for ONNX node: /encoder/3/encoder/2/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Shape [Shape] outputs: [/encoder/3/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Gather [Gather] inputs: [/encoder/3/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Gather for ONNX node: /encoder/3/encoder/2/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Gather [Gather] outputs: [/encoder/3/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Add [Add] inputs: [/encoder/3/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Add for ONNX node: /encoder/3/encoder/2/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Add [Add] outputs: [/encoder/3/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Div [Div] inputs: [/encoder/3/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Div for ONNX node: /encoder/3/encoder/2/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Div_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Div [Div] outputs: [/encoder/3/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul [Mul] inputs: [/encoder/3/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Mul for ONNX node: /encoder/3/encoder/2/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul [Mul] outputs: [/encoder/3/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Slice [Slice] inputs: [/encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Slice for ONNX node: /encoder/3/encoder/2/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Slice_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Slice [Slice] outputs: [/encoder/3/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_5 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul_1 [Mul] inputs: [/encoder/3/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_5_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Mul_1 for ONNX node: /encoder/3/encoder/2/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul_1 [Mul] outputs: [/encoder/3/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Slice_1 [Slice] inputs: [/encoder/3/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Slice_1 for ONNX node: /encoder/3/encoder/2/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Slice_1 [Slice] outputs: [/encoder/3/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul_2 [Mul] inputs: [/encoder/3/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Mul_2 for ONNX node: /encoder/3/encoder/2/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Mul_2 [Mul] outputs: [/encoder/3/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Transpose [Transpose] inputs: [/encoder/3/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Transpose for ONNX node: /encoder/3/encoder/2/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Transpose [Transpose] outputs: [/encoder/3/encoder/2/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Shape_1 for ONNX node: /encoder/3/encoder/2/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Expand for ONNX node: /encoder/3/encoder/2/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Expand_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Expand [Expand] outputs: [/encoder/3/encoder/2/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Cast [Cast] inputs: [/encoder/3/encoder/2/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Cast for ONNX node: /encoder/3/encoder/2/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Cast [Cast] outputs: [/encoder/3/encoder/2/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Constant_6 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Where [Where] inputs: [/encoder/3/encoder/2/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/2/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Constant_6_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Where for ONNX node: /encoder/3/encoder/2/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Where [Where] outputs: [/encoder/3/encoder/2/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/2/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.2.conv_module1.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/Transpose_1 for ONNX node: /encoder/3/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Sub for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Exp for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Add [Add] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Add for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Log [Log] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Log for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Log [Log] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Cast for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Equal for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Where [Where] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Where for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Where [Where] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Mul for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9544 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9544 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9544 for ONNX node: onnx::MatMul_9544 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/2/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_3 [Add] inputs: [/encoder/3/encoder/2/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_3 for ONNX node: /encoder/3/encoder/2/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_3_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_3 [Add] outputs: [/encoder/3/encoder/2/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9545 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9545 -> (512, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9545 for ONNX node: onnx::MatMul_9545 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias -> (1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/in_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Sub for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Exp for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Add [Add] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Log [Log] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Log for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Log [Log] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Cast for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Equal for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Where [Where] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Where for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Where [Where] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Mul for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9546 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [onnx::MatMul_9546 -> (1536, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9546 for ONNX node: onnx::MatMul_9546 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_4 [Add] inputs: [/encoder/3/encoder/2/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_4 for ONNX node: /encoder/3/encoder/2/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_4_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_4 [Add] outputs: [/encoder/3/encoder/2/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Sub [Sub] inputs: [/encoder/3/encoder/2/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass_mid/Sub for ONNX node: /encoder/3/encoder/2/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Sub [Sub] outputs: [/encoder/3/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Mul [Mul] inputs: [/encoder/3/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass_mid/Mul for ONNX node: /encoder/3/encoder/2/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Mul [Mul] outputs: [/encoder/3/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Add [Add] inputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass_mid/Add for ONNX node: /encoder/3/encoder/2/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass_mid/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass_mid/Add [Add] outputs: [/encoder/3/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape [Shape] inputs: [/encoder/3/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Shape for ONNX node: /encoder/3/encoder/2/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape [Shape] outputs: [/encoder/3/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant [Constant] outputs: [/encoder/3/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather [Gather] inputs: [/encoder/3/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Constant_output_0 for ONNX node: /encoder/3/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Gather for ONNX node: /encoder/3/encoder/2/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather [Gather] outputs: [/encoder/3/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Shape_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather_1 [Gather] inputs: [/encoder/3/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Gather_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather_1 [Gather] outputs: [/encoder/3/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9547 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9547 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9547 for ONNX node: onnx::MatMul_9547 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/in_proj/Add for ONNX node: /encoder/3/encoder/2/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4785 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4785 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4785 [Constant] outputs: [onnx::Unsqueeze_5871 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5871 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5871 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4787 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4787 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4787 [Constant] outputs: [onnx::Unsqueeze_5873 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5873 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5873 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4789 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4789 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4789 [Constant] outputs: [onnx::Unsqueeze_5875 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5875 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_5875 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze_2 for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Concat [Concat] inputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Concat for ONNX node: /encoder/3/encoder/2/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Concat_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Concat [Concat] outputs: [/encoder/3/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Reshape [Reshape] inputs: [/encoder/3/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Reshape for ONNX node: /encoder/3/encoder/2/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Reshape [Reshape] outputs: [/encoder/3/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Transpose [Transpose] inputs: [/encoder/3/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Transpose for ONNX node: /encoder/3/encoder/2/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Transpose [Transpose] outputs: [/encoder/3/encoder/2/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape_2 [Shape] inputs: [/encoder/3/encoder/2/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Shape_2 for ONNX node: /encoder/3/encoder/2/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Shape_2 [Shape] outputs: [/encoder/3/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather_2 [Gather] inputs: [/encoder/3/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Gather_2 for ONNX node: /encoder/3/encoder/2/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Gather_2 [Gather] outputs: [/encoder/3/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/MatMul [MatMul] inputs: [/encoder/3/encoder/2/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/2/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/MatMul for ONNX node: /encoder/3/encoder/2/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Transpose_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Mul [Mul] inputs: [/encoder/3/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Mul for ONNX node: /encoder/3/encoder/2/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Mul [Mul] outputs: [/encoder/3/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4801 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4801 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4801 [Constant] outputs: [onnx::Unsqueeze_5888 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5888 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_5888 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze_3 for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4803 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4803 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4803 [Constant] outputs: [onnx::Unsqueeze_5890 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5890 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_5890 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze_4 for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4805 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4805 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4805 [Constant] outputs: [onnx::Unsqueeze_5892 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_5892 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_5892 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Unsqueeze_5 for ONNX node: /encoder/3/encoder/2/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Concat_1 [Concat] inputs: [/encoder/3/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Concat_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Concat_1 [Concat] outputs: [/encoder/3/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/Reshape_1 for ONNX node: /encoder/3/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9549 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9549 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9549 for ONNX node: onnx::MatMul_9549 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/self_attn2/out_proj/Add for ONNX node: /encoder/3/encoder/2/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/self_attn2/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_5 [Add] inputs: [/encoder/3/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_5 for ONNX node: /encoder/3/encoder/2/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_5_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_5 [Add] outputs: [/encoder/3/encoder/2/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9550 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9550 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9550 for ONNX node: onnx::MatMul_9550 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/in_proj/Add for ONNX node: /encoder/3/encoder/2/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Shape [Shape] inputs: [/encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Shape for ONNX node: /encoder/3/encoder/2/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Shape [Shape] outputs: [/encoder/3/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Gather [Gather] inputs: [/encoder/3/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Gather for ONNX node: /encoder/3/encoder/2/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Gather [Gather] outputs: [/encoder/3/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Add [Add] inputs: [/encoder/3/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Add for ONNX node: /encoder/3/encoder/2/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Add [Add] outputs: [/encoder/3/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Div [Div] inputs: [/encoder/3/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Div for ONNX node: /encoder/3/encoder/2/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Div_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Div [Div] outputs: [/encoder/3/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul [Mul] inputs: [/encoder/3/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Mul for ONNX node: /encoder/3/encoder/2/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul [Mul] outputs: [/encoder/3/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Slice [Slice] inputs: [/encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Slice for ONNX node: /encoder/3/encoder/2/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Slice_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Slice [Slice] outputs: [/encoder/3/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_5 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul_1 [Mul] inputs: [/encoder/3/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_5_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Mul_1 for ONNX node: /encoder/3/encoder/2/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul_1 [Mul] outputs: [/encoder/3/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Slice_1 [Slice] inputs: [/encoder/3/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Slice_1 for ONNX node: /encoder/3/encoder/2/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Slice_1 [Slice] outputs: [/encoder/3/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul_2 [Mul] inputs: [/encoder/3/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Mul_2 for ONNX node: /encoder/3/encoder/2/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Mul_2 [Mul] outputs: [/encoder/3/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Transpose [Transpose] inputs: [/encoder/3/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Transpose for ONNX node: /encoder/3/encoder/2/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Transpose [Transpose] outputs: [/encoder/3/encoder/2/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Shape_1 [Shape] inputs: [/encoder/3/encoder/2/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Shape_1 for ONNX node: /encoder/3/encoder/2/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Shape_1 [Shape] outputs: [/encoder/3/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Expand for ONNX node: /encoder/3/encoder/2/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Expand_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Expand [Expand] outputs: [/encoder/3/encoder/2/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Cast [Cast] inputs: [/encoder/3/encoder/2/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Cast for ONNX node: /encoder/3/encoder/2/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Cast [Cast] outputs: [/encoder/3/encoder/2/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Constant_6 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Where [Where] inputs: [/encoder/3/encoder/2/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/2/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Constant_6_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Where for ONNX node: /encoder/3/encoder/2/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Where [Where] outputs: [/encoder/3/encoder/2/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/2/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.2.conv_module2.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/Transpose_1 for ONNX node: /encoder/3/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Sub for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Exp for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Add [Add] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Add for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Log [Log] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Log for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Log [Log] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Cast for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Equal for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Where [Where] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Where for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Where [Where] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Mul for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9551 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9551 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9551 for ONNX node: onnx::MatMul_9551 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/conv_module2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/2/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_6 [Add] inputs: [/encoder/3/encoder/2/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_6 for ONNX node: /encoder/3/encoder/2/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_6_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_6 [Add] outputs: [/encoder/3/encoder/2/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9552 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9552 -> (512, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9552 for ONNX node: onnx::MatMul_9552 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias -> (1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/in_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/in_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Sub for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Exp for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Add [Add] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Add for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Add [Add] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Log [Log] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Log for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Log [Log] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Cast for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Equal for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Where [Where] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Where for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Where [Where] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Mul for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9553 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [onnx::MatMul_9553 -> (1920, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9553 for ONNX node: onnx::MatMul_9553 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_7 [Add] inputs: [/encoder/3/encoder/2/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/Add_7 for ONNX node: /encoder/3/encoder/2/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/Add_7_output_0 for ONNX tensor: /encoder/3/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/Add_7 [Add] outputs: [/encoder/3/encoder/2/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Sub [Sub] inputs: [/encoder/3/encoder/2/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.2.norm.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.norm.bias for ONNX node: encoder.encoders.3.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Sub for ONNX node: /encoder/3/encoder/2/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Sub [Sub] outputs: [/encoder/3/encoder/2/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Constant [Constant] outputs: [/encoder/3/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Pow [Pow] inputs: [/encoder/3/encoder/2/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Constant_output_0 for ONNX node: /encoder/3/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Pow for ONNX node: /encoder/3/encoder/2/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Pow_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Pow [Pow] outputs: [/encoder/3/encoder/2/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/ReduceMean [ReduceMean] inputs: [/encoder/3/encoder/2/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/ReduceMean for ONNX node: /encoder/3/encoder/2/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/ReduceMean_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/ReduceMean [ReduceMean] outputs: [/encoder/3/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Constant_1 [Constant] outputs: [/encoder/3/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Pow_1 [Pow] inputs: [/encoder/3/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Constant_1_output_0 for ONNX node: /encoder/3/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Pow_1 for ONNX node: /encoder/3/encoder/2/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Pow_1_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Pow_1 [Pow] outputs: [/encoder/3/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Exp [Exp] inputs: [encoder.encoders.3.encoder.layers.2.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.norm.log_scale for ONNX node: encoder.encoders.3.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Exp for ONNX node: /encoder/3/encoder/2/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Exp_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Exp [Exp] outputs: [/encoder/3/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Mul [Mul] inputs: [/encoder/3/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Mul for ONNX node: /encoder/3/encoder/2/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Mul [Mul] outputs: [/encoder/3/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Mul_1 [Mul] inputs: [/encoder/3/encoder/2/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/norm/Mul_1 for ONNX node: /encoder/3/encoder/2/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/norm/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/norm/Mul_1 [Mul] outputs: [/encoder/3/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Sub [Sub] inputs: [/encoder/3/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass/Sub for ONNX node: /encoder/3/encoder/2/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass/Sub_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Sub [Sub] outputs: [/encoder/3/encoder/2/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Mul [Mul] inputs: [/encoder/3/encoder/2/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.2.bypass.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.2.bypass.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass/Mul for ONNX node: /encoder/3/encoder/2/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass/Mul_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Mul [Mul] outputs: [/encoder/3/encoder/2/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/2/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Add [Add] inputs: [/encoder/3/encoder/1/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/2/bypass/Add for ONNX node: /encoder/3/encoder/2/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/2/bypass/Add_output_0 for ONNX tensor: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/2/bypass/Add [Add] outputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9554 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9554 -> (512, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9554 for ONNX node: onnx::MatMul_9554 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias -> (544)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/in_proj/Add for ONNX node: /encoder/3/encoder/3/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice [Slice] inputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Slice for ONNX node: /encoder/3/encoder/3/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice [Slice] outputs: [/encoder/3/encoder/3/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Slice_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/3/encoder/3/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/3/encoder/3/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 544)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Slice_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/3/encoder/3/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4911 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4911 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4911 [Constant] outputs: [onnx::Unsqueeze_6004 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6004 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6004 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4913 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4913 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4913 [Constant] outputs: [onnx::Unsqueeze_6006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6006 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4918 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4918 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4918 [Constant] outputs: [onnx::Unsqueeze_6013 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6013 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6013 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4920 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4920 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4920 [Constant] outputs: [onnx::Unsqueeze_6015 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6015 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6015 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4926 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4926 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4926 [Constant] outputs: [onnx::Unsqueeze_6023 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6023 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6023 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4928 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4928 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4928 [Constant] outputs: [onnx::Unsqueeze_6025 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6025 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6025 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/Slice_2_output_0 -> (-1, -1, 32)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose [Transpose] inputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Transpose for ONNX node: /encoder/3/encoder/3/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose [Transpose] outputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Transpose_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 8, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Transpose_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/MatMul [MatMul] inputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_output_0 -> (8, -1, -1, 32)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Transpose_2_output_0 -> (8, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/MatMul for ONNX node: /encoder/3/encoder/3/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9561 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/3/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9561 -> (48, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9561 for ONNX node: onnx::MatMul_9561 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Mul [Mul] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Mul for ONNX node: /encoder/3/encoder/3/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Mul [Mul] outputs: [/encoder/3/encoder/3/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Sub [Sub] inputs: [/encoder/3/encoder/3/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Sub for ONNX node: /encoder/3/encoder/3/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Sub [Sub] outputs: [/encoder/3/encoder/3/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4945 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4945 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4945 [Constant] outputs: [onnx::Unsqueeze_6046 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6046 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_6046 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 32)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 8, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Transpose_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/3/encoder/3/self_attn_weights/Transpose_1_output_0 -> (8, -1, -1, 4)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Transpose_3_output_0 -> (8, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/MatMul_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather_3 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_4 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather_4 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_5 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Gather_5 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/3/encoder/3/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Sub_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast [Cast] inputs: [/encoder/3/encoder/3/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Cast for ONNX node: /encoder/3/encoder/3/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast [Cast] outputs: [/encoder/3/encoder/3/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Range [Range] inputs: [/encoder/3/encoder/3/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Range for ONNX node: /encoder/3/encoder/3/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Range [Range] outputs: [/encoder/3/encoder/3/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Cast_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/3/encoder/3/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Range_1 [Range] inputs: [/encoder/3/encoder/3/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Range_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Range_1 [Range] outputs: [/encoder/3/encoder/3/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Mul_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4976 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4976 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4976 [Constant] outputs: [onnx::Unsqueeze_6079 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6079 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6079 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_4 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4979 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4979 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4979 [Constant] outputs: [onnx::Unsqueeze_6082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6082 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_5 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Shape_6 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/3/encoder/3/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/encoder/3/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/encoder/3/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Expand [Expand] inputs: [/encoder/3/encoder/3/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Expand for ONNX node: /encoder/3/encoder/3/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Expand [Expand] outputs: [/encoder/3/encoder/3/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Tile [Tile] inputs: [/encoder/3/encoder/3/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Tile for ONNX node: /encoder/3/encoder/3/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Tile [Tile] outputs: [/encoder/3/encoder/3/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Add [Add] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Add for ONNX node: /encoder/3/encoder/3/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Add [Add] outputs: [/encoder/3/encoder/3/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4990 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4990 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4990 [Constant] outputs: [onnx::Unsqueeze_6094 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6094 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_6094 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_6 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape_4 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/GatherElements for ONNX node: /encoder/3/encoder/3/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/3/encoder/3/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4995 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4995 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4995 [Constant] outputs: [onnx::Unsqueeze_6099 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6099 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6099 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4997 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4997 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4997 [Constant] outputs: [onnx::Unsqueeze_6101 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6101 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6101 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_4999 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_4999 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_4999 [Constant] outputs: [onnx::Unsqueeze_6103 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6103 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6103 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5001 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5001 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5001 [Constant] outputs: [onnx::Unsqueeze_6105 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6105 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6105 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Concat_7 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/3/encoder/3/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/3/encoder/3/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Reshape_5 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/3/encoder/3/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Add_1 [Add] inputs: [/encoder/3/encoder/3/self_attn_weights/MatMul_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Reshape_5_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Add_1 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Add_1 [Add] outputs: [/encoder/3/encoder/3/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Cast_2 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/3/encoder/3/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Where [Where] inputs: [/encoder/3/encoder/3/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/3/encoder/3/self_attn_weights/Add_1_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Where for ONNX node: /encoder/3/encoder/3/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Where [Where] outputs: [/encoder/3/encoder/3/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Softmax [Softmax] inputs: [/encoder/3/encoder/3/self_attn_weights/Where_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn_weights/Softmax for ONNX node: /encoder/3/encoder/3/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn_weights/Softmax [Softmax] outputs: [/encoder/3/encoder/3/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9568 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9568 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9568 for ONNX node: onnx::MatMul_9568 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/in_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Sub for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Exp for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Add [Add] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Log [Log] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Log for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Log [Log] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Cast for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Equal for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Where [Where] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 1152)[BOOL]], [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Where for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Where [Where] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/3/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Mul for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9569 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 1152)[FLOAT]], [onnx::MatMul_9569 -> (1152, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9569 for ONNX node: onnx::MatMul_9569 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/3/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add [Add] inputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add for ONNX node: /encoder/3/encoder/3/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add [Add] outputs: [/encoder/3/encoder/3/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant [Constant] outputs: [/encoder/3/encoder/3/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Slice [Slice] inputs: [/encoder/3/encoder/3/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/Constant_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Slice for ONNX node: /encoder/3/encoder/3/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Slice_output_0 for ONNX tensor: /encoder/3/encoder/3/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Slice [Slice] outputs: [/encoder/3/encoder/3/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9570 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9570 -> (512, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9570 for ONNX node: onnx::MatMul_9570 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias -> (1152)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/in_proj/Add for ONNX node: /encoder/3/encoder/3/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape [Shape] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Add [Add] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Add for ONNX node: /encoder/3/encoder/3/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Add [Add] outputs: [/encoder/3/encoder/3/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Div [Div] inputs: [/encoder/3/encoder/3/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Div for ONNX node: /encoder/3/encoder/3/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Div [Div] outputs: [/encoder/3/encoder/3/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul [Mul] inputs: [/encoder/3/encoder/3/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Mul for ONNX node: /encoder/3/encoder/3/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul [Mul] outputs: [/encoder/3/encoder/3/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice [Slice] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Slice for ONNX node: /encoder/3/encoder/3/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice [Slice] outputs: [/encoder/3/encoder/3/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/3/encoder/3/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Mul_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Slice_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/3/encoder/3/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/3/encoder/3/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Mul_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/3/encoder/3/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/3/encoder/3/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 1152)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Slice_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/3/encoder/3/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/3/encoder/3/nonlin_attention/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh for ONNX node: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/3/encoder/3/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5063 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5063 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5063 [Constant] outputs: [onnx::Unsqueeze_6170 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6170 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6170 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5065 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5065 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5065 [Constant] outputs: [onnx::Unsqueeze_6172 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6172 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6172 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat [Concat] inputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Concat for ONNX node: /encoder/3/encoder/3/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat [Concat] outputs: [/encoder/3/encoder/3/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape [Reshape] inputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 384, 1)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Reshape for ONNX node: /encoder/3/encoder/3/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape [Reshape] outputs: [/encoder/3/encoder/3/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/3/encoder/3/nonlin_attention/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Reshape_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Mul_3 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape_3 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather_3 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape_4 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather_4 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/3/encoder/3/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Shape_5 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/3/encoder/3/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/3/encoder/3/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Gather_5 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/3/encoder/3/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5080 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5080 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5080 [Constant] outputs: [onnx::Unsqueeze_6188 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6188 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6188 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5082 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5082 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5082 [Constant] outputs: [onnx::Unsqueeze_6190 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6190 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6190 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5084 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5084 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5084 [Constant] outputs: [onnx::Unsqueeze_6192 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6192 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_6192 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Concat_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/3/encoder/3/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/3/nonlin_attention/Mul_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Reshape_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/3/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Transpose [Transpose] inputs: [/encoder/3/encoder/3/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Transpose for ONNX node: /encoder/3/encoder/3/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Transpose [Transpose] outputs: [/encoder/3/encoder/3/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/MatMul for ONNX node: /encoder/3/encoder/3/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/MatMul [MatMul] outputs: [/encoder/3/encoder/3/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Transpose_1 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5092 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5092 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5092 [Constant] outputs: [onnx::Unsqueeze_6201 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6201 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6201 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5094 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5094 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5094 [Constant] outputs: [onnx::Unsqueeze_6203 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6203 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/3/encoder/3/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6203 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/3/encoder/3/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Concat_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/3/encoder/3/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/3/encoder/3/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 384)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Reshape_2 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/3/encoder/3/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/3/encoder/3/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/Slice_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/Mul_4 for ONNX node: /encoder/3/encoder/3/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/3/encoder/3/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9574 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/nonlin_attention/Mul_4_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9574 -> (384, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9574 for ONNX node: onnx::MatMul_9574 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/nonlin_attention/out_proj/Add for ONNX node: /encoder/3/encoder/3/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_1 [Add] inputs: [/encoder/3/encoder/3/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_1 for ONNX node: /encoder/3/encoder/3/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_1 [Add] outputs: [/encoder/3/encoder/3/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape [Shape] inputs: [/encoder/3/encoder/3/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Shape for ONNX node: /encoder/3/encoder/3/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape [Shape] outputs: [/encoder/3/encoder/3/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant [Constant] outputs: [/encoder/3/encoder/3/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather [Gather] inputs: [/encoder/3/encoder/3/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Constant_output_0 for ONNX node: /encoder/3/encoder/3/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Gather for ONNX node: /encoder/3/encoder/3/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather [Gather] outputs: [/encoder/3/encoder/3/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Shape_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_1 [Gather] inputs: [/encoder/3/encoder/3/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Gather_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_1 [Gather] outputs: [/encoder/3/encoder/3/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_2 [Shape] inputs: [/encoder/3/encoder/3/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Shape_2 for ONNX node: /encoder/3/encoder/3/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_2 [Shape] outputs: [/encoder/3/encoder/3/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_2 [Gather] inputs: [/encoder/3/encoder/3/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Gather_2 for ONNX node: /encoder/3/encoder/3/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_2 [Gather] outputs: [/encoder/3/encoder/3/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9575 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9575 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9575 for ONNX node: onnx::MatMul_9575 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/3/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/in_proj/Add for ONNX node: /encoder/3/encoder/3/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5114 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5114 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5114 [Constant] outputs: [onnx::Unsqueeze_6226 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6226 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6226 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5116 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5116 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5116 [Constant] outputs: [onnx::Unsqueeze_6228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6228 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5118 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5118 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5118 [Constant] outputs: [onnx::Unsqueeze_6230 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6230 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6230 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze_2 for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Concat [Concat] inputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Concat for ONNX node: /encoder/3/encoder/3/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Concat_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Concat [Concat] outputs: [/encoder/3/encoder/3/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Reshape [Reshape] inputs: [/encoder/3/encoder/3/self_attn1/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/3/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Reshape for ONNX node: /encoder/3/encoder/3/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Reshape [Reshape] outputs: [/encoder/3/encoder/3/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Transpose [Transpose] inputs: [/encoder/3/encoder/3/self_attn1/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Transpose for ONNX node: /encoder/3/encoder/3/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Transpose [Transpose] outputs: [/encoder/3/encoder/3/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_3 [Shape] inputs: [/encoder/3/encoder/3/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Shape_3 for ONNX node: /encoder/3/encoder/3/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Shape_3 [Shape] outputs: [/encoder/3/encoder/3/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_3 [Gather] inputs: [/encoder/3/encoder/3/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Gather_3 for ONNX node: /encoder/3/encoder/3/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Gather_3 [Gather] outputs: [/encoder/3/encoder/3/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/MatMul [MatMul] inputs: [/encoder/3/encoder/3/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn1/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/MatMul for ONNX node: /encoder/3/encoder/3/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/self_attn1/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Transpose_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Mul [Mul] inputs: [/encoder/3/encoder/3/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Mul for ONNX node: /encoder/3/encoder/3/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Mul [Mul] outputs: [/encoder/3/encoder/3/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5130 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5130 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5130 [Constant] outputs: [onnx::Unsqueeze_6243 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6243 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6243 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze_3 for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5132 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5132 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5132 [Constant] outputs: [onnx::Unsqueeze_6245 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6245 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6245 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze_4 for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5134 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5134 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5134 [Constant] outputs: [onnx::Unsqueeze_6247 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6247 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_6247 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Unsqueeze_5 for ONNX node: /encoder/3/encoder/3/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Concat_1 [Concat] inputs: [/encoder/3/encoder/3/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Concat_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Concat_1 [Concat] outputs: [/encoder/3/encoder/3/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/3/self_attn1/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/3/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/Reshape_1 for ONNX node: /encoder/3/encoder/3/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/3/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9577 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/self_attn1/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9577 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9577 for ONNX node: onnx::MatMul_9577 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn1/out_proj/Add for ONNX node: /encoder/3/encoder/3/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn1/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_2 [Add] inputs: [/encoder/3/encoder/3/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/self_attn1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_2 for ONNX node: /encoder/3/encoder/3/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_2_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_2 [Add] outputs: [/encoder/3/encoder/3/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9578 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9578 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9578 for ONNX node: onnx::MatMul_9578 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/3/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/in_proj/Add for ONNX node: /encoder/3/encoder/3/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Shape [Shape] inputs: [/encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Shape for ONNX node: /encoder/3/encoder/3/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Shape [Shape] outputs: [/encoder/3/encoder/3/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Gather [Gather] inputs: [/encoder/3/encoder/3/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Gather for ONNX node: /encoder/3/encoder/3/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Gather [Gather] outputs: [/encoder/3/encoder/3/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Add [Add] inputs: [/encoder/3/encoder/3/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Add for ONNX node: /encoder/3/encoder/3/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Add [Add] outputs: [/encoder/3/encoder/3/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Div [Div] inputs: [/encoder/3/encoder/3/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Div for ONNX node: /encoder/3/encoder/3/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Div_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Div [Div] outputs: [/encoder/3/encoder/3/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul [Mul] inputs: [/encoder/3/encoder/3/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Mul for ONNX node: /encoder/3/encoder/3/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul [Mul] outputs: [/encoder/3/encoder/3/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Slice [Slice] inputs: [/encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/3/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Slice for ONNX node: /encoder/3/encoder/3/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Slice_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Slice [Slice] outputs: [/encoder/3/encoder/3/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_5 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul_1 [Mul] inputs: [/encoder/3/encoder/3/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_5_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Mul_1 for ONNX node: /encoder/3/encoder/3/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul_1 [Mul] outputs: [/encoder/3/encoder/3/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Slice_1 [Slice] inputs: [/encoder/3/encoder/3/conv_module1/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/3/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Slice_1 for ONNX node: /encoder/3/encoder/3/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Slice_1 [Slice] outputs: [/encoder/3/encoder/3/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/3/conv_module1/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul_2 [Mul] inputs: [/encoder/3/encoder/3/conv_module1/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Mul_2 for ONNX node: /encoder/3/encoder/3/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Mul_2 [Mul] outputs: [/encoder/3/encoder/3/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Transpose [Transpose] inputs: [/encoder/3/encoder/3/conv_module1/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Transpose for ONNX node: /encoder/3/encoder/3/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Transpose [Transpose] outputs: [/encoder/3/encoder/3/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Shape_1 for ONNX node: /encoder/3/encoder/3/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/3/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Expand for ONNX node: /encoder/3/encoder/3/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Expand_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Expand [Expand] outputs: [/encoder/3/encoder/3/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Cast [Cast] inputs: [/encoder/3/encoder/3/conv_module1/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Cast for ONNX node: /encoder/3/encoder/3/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Cast [Cast] outputs: [/encoder/3/encoder/3/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Constant_6 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Where [Where] inputs: [/encoder/3/encoder/3/conv_module1/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/3/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/3/conv_module1/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Constant_6_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Where for ONNX node: /encoder/3/encoder/3/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Where [Where] outputs: [/encoder/3/encoder/3/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/3/conv_module1/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.3.conv_module1.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/3/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/Transpose_1 for ONNX node: /encoder/3/encoder/3/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/3/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Sub for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Exp for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Add [Add] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Add for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Log [Log] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Log for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Log [Log] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Cast for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Equal for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Where [Where] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/3/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Where for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Where [Where] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/3/conv_module1/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Mul for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9579 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9579 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9579 for ONNX node: onnx::MatMul_9579 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module1/out_proj/Add_1 for ONNX node: /encoder/3/encoder/3/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/3/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_3 [Add] inputs: [/encoder/3/encoder/3/Add_2_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_3 for ONNX node: /encoder/3/encoder/3/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_3_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_3 [Add] outputs: [/encoder/3/encoder/3/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9580 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9580 -> (512, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9580 for ONNX node: onnx::MatMul_9580 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias -> (1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/in_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Sub for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Exp for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Add [Add] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Log [Log] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Log for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Log [Log] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Cast for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Equal for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Where [Where] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1536)[BOOL]], [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Where for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Where [Where] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/3/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Mul for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1536)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9581 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1536)[FLOAT]], [onnx::MatMul_9581 -> (1536, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9581 for ONNX node: onnx::MatMul_9581 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/3/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_4 [Add] inputs: [/encoder/3/encoder/3/Add_3_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_4 for ONNX node: /encoder/3/encoder/3/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_4_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_4 [Add] outputs: [/encoder/3/encoder/3/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Sub [Sub] inputs: [/encoder/3/encoder/3/Add_4_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass_mid/Sub for ONNX node: /encoder/3/encoder/3/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Sub [Sub] outputs: [/encoder/3/encoder/3/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Mul [Mul] inputs: [/encoder/3/encoder/3/bypass_mid/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass_mid/Mul for ONNX node: /encoder/3/encoder/3/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Mul [Mul] outputs: [/encoder/3/encoder/3/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Add [Add] inputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/bypass_mid/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass_mid/Add for ONNX node: /encoder/3/encoder/3/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass_mid/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass_mid/Add [Add] outputs: [/encoder/3/encoder/3/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape [Shape] inputs: [/encoder/3/encoder/3/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Shape for ONNX node: /encoder/3/encoder/3/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape [Shape] outputs: [/encoder/3/encoder/3/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant [Constant] outputs: [/encoder/3/encoder/3/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather [Gather] inputs: [/encoder/3/encoder/3/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Constant_output_0 for ONNX node: /encoder/3/encoder/3/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Gather for ONNX node: /encoder/3/encoder/3/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather [Gather] outputs: [/encoder/3/encoder/3/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Shape_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather_1 [Gather] inputs: [/encoder/3/encoder/3/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Gather_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather_1 [Gather] outputs: [/encoder/3/encoder/3/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9582 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9582 -> (512, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9582 for ONNX node: onnx::MatMul_9582 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias -> (96)[FLOAT]], [/encoder/3/encoder/3/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/in_proj/Add for ONNX node: /encoder/3/encoder/3/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5216 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5216 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5216 [Constant] outputs: [onnx::Unsqueeze_6335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6335 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5218 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5218 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5218 [Constant] outputs: [onnx::Unsqueeze_6337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6337 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5220 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5220 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5220 [Constant] outputs: [onnx::Unsqueeze_6339 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6339 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6339 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze_2 for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Concat [Concat] inputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Concat for ONNX node: /encoder/3/encoder/3/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Concat_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Concat [Concat] outputs: [/encoder/3/encoder/3/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Reshape [Reshape] inputs: [/encoder/3/encoder/3/self_attn2/in_proj/Add_output_0 -> (-1, -1, 96)[FLOAT]], [/encoder/3/encoder/3/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Reshape for ONNX node: /encoder/3/encoder/3/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Reshape [Reshape] outputs: [/encoder/3/encoder/3/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Transpose [Transpose] inputs: [/encoder/3/encoder/3/self_attn2/Reshape_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Transpose for ONNX node: /encoder/3/encoder/3/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Transpose [Transpose] outputs: [/encoder/3/encoder/3/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape_2 [Shape] inputs: [/encoder/3/encoder/3/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Shape_2 for ONNX node: /encoder/3/encoder/3/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Shape_2 [Shape] outputs: [/encoder/3/encoder/3/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather_2 [Gather] inputs: [/encoder/3/encoder/3/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/3/encoder/3/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Gather_2 for ONNX node: /encoder/3/encoder/3/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Gather_2 [Gather] outputs: [/encoder/3/encoder/3/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/MatMul [MatMul] inputs: [/encoder/3/encoder/3/self_attn_weights/Softmax_output_0 -> (8, -1, -1, -1)[FLOAT]], [/encoder/3/encoder/3/self_attn2/Transpose_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/MatMul for ONNX node: /encoder/3/encoder/3/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/self_attn2/MatMul_output_0 -> (8, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Transpose_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Mul [Mul] inputs: [/encoder/3/encoder/3/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/3/encoder/3/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Mul for ONNX node: /encoder/3/encoder/3/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Mul [Mul] outputs: [/encoder/3/encoder/3/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5232 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5232 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5232 [Constant] outputs: [onnx::Unsqueeze_6352 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6352 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6352 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze_3 for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5234 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5234 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5234 [Constant] outputs: [onnx::Unsqueeze_6354 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6354 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6354 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze_4 for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5236 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5236 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5236 [Constant] outputs: [onnx::Unsqueeze_6356 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6356 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/encoder/3/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_6356 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Unsqueeze_5 for ONNX node: /encoder/3/encoder/3/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Concat_1 [Concat] inputs: [/encoder/3/encoder/3/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Concat_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Concat_1 [Concat] outputs: [/encoder/3/encoder/3/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/3/encoder/3/self_attn2/Transpose_1_output_0 -> (-1, -1, 8, 12)[FLOAT]], [/encoder/3/encoder/3/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/Reshape_1 for ONNX node: /encoder/3/encoder/3/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/3/encoder/3/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9584 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/self_attn2/Reshape_1_output_0 -> (-1, -1, 96)[FLOAT]], [onnx::MatMul_9584 -> (96, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9584 for ONNX node: onnx::MatMul_9584 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/self_attn2/out_proj/Add for ONNX node: /encoder/3/encoder/3/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/self_attn2/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_5 [Add] inputs: [/encoder/3/encoder/3/bypass_mid/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/self_attn2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_5 for ONNX node: /encoder/3/encoder/3/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_5_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_5 [Add] outputs: [/encoder/3/encoder/3/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9585 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9585 -> (512, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9585 for ONNX node: onnx::MatMul_9585 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias -> (1024)[FLOAT]], [/encoder/3/encoder/3/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/in_proj/Add for ONNX node: /encoder/3/encoder/3/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Shape [Shape] inputs: [/encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Shape for ONNX node: /encoder/3/encoder/3/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Shape_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Shape [Shape] outputs: [/encoder/3/encoder/3/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Gather [Gather] inputs: [/encoder/3/encoder/3/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Gather for ONNX node: /encoder/3/encoder/3/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Gather_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Gather [Gather] outputs: [/encoder/3/encoder/3/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Add [Add] inputs: [/encoder/3/encoder/3/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Add for ONNX node: /encoder/3/encoder/3/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Add [Add] outputs: [/encoder/3/encoder/3/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Div [Div] inputs: [/encoder/3/encoder/3/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Div for ONNX node: /encoder/3/encoder/3/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Div_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Div [Div] outputs: [/encoder/3/encoder/3/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul [Mul] inputs: [/encoder/3/encoder/3/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Mul for ONNX node: /encoder/3/encoder/3/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul [Mul] outputs: [/encoder/3/encoder/3/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Slice [Slice] inputs: [/encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/3/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Slice for ONNX node: /encoder/3/encoder/3/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Slice_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Slice [Slice] outputs: [/encoder/3/encoder/3/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_5 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul_1 [Mul] inputs: [/encoder/3/encoder/3/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_5_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Mul_1 for ONNX node: /encoder/3/encoder/3/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul_1 [Mul] outputs: [/encoder/3/encoder/3/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Slice_1 [Slice] inputs: [/encoder/3/encoder/3/conv_module2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/3/encoder/3/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/3/encoder/3/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Slice_1 for ONNX node: /encoder/3/encoder/3/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Slice_1 [Slice] outputs: [/encoder/3/encoder/3/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/3/encoder/3/conv_module2/Slice_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul_2 [Mul] inputs: [/encoder/3/encoder/3/conv_module2/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Mul_2 for ONNX node: /encoder/3/encoder/3/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Mul_2 [Mul] outputs: [/encoder/3/encoder/3/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Transpose [Transpose] inputs: [/encoder/3/encoder/3/conv_module2/Mul_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Transpose for ONNX node: /encoder/3/encoder/3/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Transpose [Transpose] outputs: [/encoder/3/encoder/3/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Shape_1 for ONNX node: /encoder/3/encoder/3/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Shape_1 [Shape] outputs: [/encoder/3/encoder/3/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Expand [Expand] inputs: [/encoder/3/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/3/encoder/3/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Expand for ONNX node: /encoder/3/encoder/3/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Expand_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Expand [Expand] outputs: [/encoder/3/encoder/3/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Cast [Cast] inputs: [/encoder/3/encoder/3/conv_module2/Expand_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Cast for ONNX node: /encoder/3/encoder/3/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Cast [Cast] outputs: [/encoder/3/encoder/3/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Constant_6 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Where [Where] inputs: [/encoder/3/encoder/3/conv_module2/Cast_output_0 -> (-1, 512, -1)[BOOL]], [/encoder/3/encoder/3/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/3/encoder/3/conv_module2/Transpose_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Constant_6_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Where for ONNX node: /encoder/3/encoder/3/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Where [Where] outputs: [/encoder/3/encoder/3/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/3/encoder/3/conv_module2/Where_output_0 -> (-1, 512, -1)[FLOAT]], [encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.weight -> (512, 1, 15)[FLOAT]], [encoder.encoders.3.encoder.layers.3.conv_module2.depthwise_conv.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 512, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 512 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/3/encoder/3/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/3/encoder/3/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 512, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/Transpose_1 for ONNX node: /encoder/3/encoder/3/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/3/encoder/3/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/3/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Sub for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Exp for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Add [Add] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Add for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Log [Log] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Log for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Log [Log] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Log_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Cast for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Equal for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Where [Where] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 512)[BOOL]], [/encoder/3/encoder/3/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Where for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Where [Where] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/3/conv_module2/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Mul for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Where_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9586 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9586 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9586 for ONNX node: onnx::MatMul_9586 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/conv_module2/out_proj/Add_1 for ONNX node: /encoder/3/encoder/3/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/3/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_6 [Add] inputs: [/encoder/3/encoder/3/Add_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_6 for ONNX node: /encoder/3/encoder/3/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_6_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_6 [Add] outputs: [/encoder/3/encoder/3/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9587 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9587 -> (512, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9587 for ONNX node: onnx::MatMul_9587 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias -> (1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/in_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/in_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Sub for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Exp for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Add [Add] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Add for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Add [Add] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Log [Log] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Log for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Log [Log] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Cast for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Equal for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Where [Where] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1920)[BOOL]], [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Where for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Where [Where] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/3/encoder/3/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Mul for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1920)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9588 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1920)[FLOAT]], [onnx::MatMul_9588 -> (1920, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9588 for ONNX node: onnx::MatMul_9588 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias -> (512)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/3/encoder/3/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_7 [Add] inputs: [/encoder/3/encoder/3/Add_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/Add_7 for ONNX node: /encoder/3/encoder/3/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/Add_7_output_0 for ONNX tensor: /encoder/3/encoder/3/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/Add_7 [Add] outputs: [/encoder/3/encoder/3/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Sub [Sub] inputs: [/encoder/3/encoder/3/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.3.norm.bias -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.norm.bias for ONNX node: encoder.encoders.3.encoder.layers.3.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Sub for ONNX node: /encoder/3/encoder/3/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Sub [Sub] outputs: [/encoder/3/encoder/3/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Constant [Constant] outputs: [/encoder/3/encoder/3/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Pow [Pow] inputs: [/encoder/3/encoder/3/norm/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Constant_output_0 for ONNX node: /encoder/3/encoder/3/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Pow for ONNX node: /encoder/3/encoder/3/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Pow_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Pow [Pow] outputs: [/encoder/3/encoder/3/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/ReduceMean [ReduceMean] inputs: [/encoder/3/encoder/3/norm/Pow_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/ReduceMean for ONNX node: /encoder/3/encoder/3/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/ReduceMean_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/ReduceMean [ReduceMean] outputs: [/encoder/3/encoder/3/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Constant_1 [Constant] outputs: [/encoder/3/encoder/3/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Pow_1 [Pow] inputs: [/encoder/3/encoder/3/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/3/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Constant_1_output_0 for ONNX node: /encoder/3/encoder/3/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Pow_1 for ONNX node: /encoder/3/encoder/3/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Pow_1_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Pow_1 [Pow] outputs: [/encoder/3/encoder/3/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Exp [Exp] inputs: [encoder.encoders.3.encoder.layers.3.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.norm.log_scale for ONNX node: encoder.encoders.3.encoder.layers.3.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Exp for ONNX node: /encoder/3/encoder/3/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Exp_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Exp [Exp] outputs: [/encoder/3/encoder/3/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Mul [Mul] inputs: [/encoder/3/encoder/3/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/3/encoder/3/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Mul for ONNX node: /encoder/3/encoder/3/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Mul [Mul] outputs: [/encoder/3/encoder/3/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Mul_1 [Mul] inputs: [/encoder/3/encoder/3/Add_7_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/norm/Mul_1 for ONNX node: /encoder/3/encoder/3/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/norm/Mul_1_output_0 for ONNX tensor: /encoder/3/encoder/3/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/norm/Mul_1 [Mul] outputs: [/encoder/3/encoder/3/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Sub [Sub] inputs: [/encoder/3/encoder/3/norm/Mul_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass/Sub for ONNX node: /encoder/3/encoder/3/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass/Sub_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Sub [Sub] outputs: [/encoder/3/encoder/3/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.encoder.layers.3.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Mul [Mul] inputs: [/encoder/3/encoder/3/bypass/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.encoder.layers.3.bypass.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.encoder.layers.3.bypass.bypass_scale for ONNX node: encoder.encoders.3.encoder.layers.3.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass/Mul for ONNX node: /encoder/3/encoder/3/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass/Mul_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Mul [Mul] outputs: [/encoder/3/encoder/3/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/encoder/3/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Add [Add] inputs: [/encoder/3/encoder/2/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/encoder/3/bypass/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/encoder/3/bypass/Add for ONNX node: /encoder/3/encoder/3/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/encoder/3/bypass/Add_output_0 for ONNX tensor: /encoder/3/encoder/3/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/encoder/3/bypass/Add [Add] outputs: [/encoder/3/encoder/3/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape [Shape] inputs: [/encoder/3/encoder/3/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Shape for ONNX node: /encoder/3/upsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Shape_output_0 for ONNX tensor: /encoder/3/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape [Shape] outputs: [/encoder/3/upsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant [Constant] outputs: [/encoder/3/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather [Gather] inputs: [/encoder/3/upsample/Shape_output_0 -> (3)[INT32]], [/encoder/3/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_output_0 for ONNX node: /encoder/3/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Gather for ONNX node: /encoder/3/upsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Gather_output_0 for ONNX tensor: /encoder/3/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather [Gather] outputs: [/encoder/3/upsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_1 [Shape] inputs: [/encoder/3/encoder/3/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Shape_1 for ONNX node: /encoder/3/upsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Shape_1_output_0 for ONNX tensor: /encoder/3/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_1 [Shape] outputs: [/encoder/3/upsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_1 [Constant] outputs: [/encoder/3/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather_1 [Gather] inputs: [/encoder/3/upsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/3/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_1_output_0 for ONNX node: /encoder/3/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Gather_1 for ONNX node: /encoder/3/upsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Gather_1_output_0 for ONNX tensor: /encoder/3/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather_1 [Gather] outputs: [/encoder/3/upsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_2 [Shape] inputs: [/encoder/3/encoder/3/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Shape_2 for ONNX node: /encoder/3/upsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Shape_2_output_0 for ONNX tensor: /encoder/3/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_2 [Shape] outputs: [/encoder/3/upsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_2 [Constant] outputs: [/encoder/3/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather_2 [Gather] inputs: [/encoder/3/upsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/3/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_2_output_0 for ONNX node: /encoder/3/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Gather_2 for ONNX node: /encoder/3/upsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Gather_2_output_0 for ONNX tensor: /encoder/3/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Gather_2 [Gather] outputs: [/encoder/3/upsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_3 [Constant] outputs: [/encoder/3/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/encoder/3/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze [Unsqueeze] inputs: [/encoder/3/encoder/3/bypass/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 512), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze for ONNX node: /encoder/3/upsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_4 [Constant] outputs: [/encoder/3/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/3/upsample/Gather_output_0 -> ()[INT32]], [/encoder/3/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_1 for ONNX node: /encoder/3/upsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_5 [Constant] outputs: [/encoder/3/upsample/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_6 [Constant] outputs: [/encoder/3/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/3/upsample/Gather_1_output_0 -> ()[INT32]], [/encoder/3/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_2 for ONNX node: /encoder/3/upsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_7 [Constant] outputs: [/encoder/3/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/3/upsample/Gather_2_output_0 -> ()[INT32]], [/encoder/3/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_3 for ONNX node: /encoder/3/upsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Concat [Concat] inputs: [/encoder/3/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/3/upsample/Constant_5_output_0 -> (1)[INT32]], [/encoder/3/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/3/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_5_output_0 for ONNX node: /encoder/3/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Concat for ONNX node: /encoder/3/upsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Concat_output_0 for ONNX tensor: /encoder/3/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Concat [Concat] outputs: [/encoder/3/upsample/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_8 [Constant] outputs: [/encoder/3/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Reshape [Reshape] inputs: [/encoder/3/upsample/Concat_output_0 -> (4)[INT32]], [/encoder/3/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Reshape for ONNX node: /encoder/3/upsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Reshape_output_0 for ONNX tensor: /encoder/3/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Reshape [Reshape] outputs: [/encoder/3/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_3 [Shape] inputs: [/encoder/3/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Shape_3 for ONNX node: /encoder/3/upsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Shape_3_output_0 for ONNX tensor: /encoder/3/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Shape_3 [Shape] outputs: [/encoder/3/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/3/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/3/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/3/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_9 [Constant] outputs: [/encoder/3/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Mul [Mul] inputs: [/encoder/3/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/3/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_9_output_0 for ONNX node: /encoder/3/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Mul for ONNX node: /encoder/3/upsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Mul_output_0 for ONNX tensor: /encoder/3/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Mul [Mul] outputs: [/encoder/3/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Equal [Equal] inputs: [/encoder/3/upsample/Reshape_output_0 -> (4)[INT32]], [/encoder/3/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Equal for ONNX node: /encoder/3/upsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Equal_output_0 for ONNX tensor: /encoder/3/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Equal [Equal] outputs: [/encoder/3/upsample/Equal_output_0 -> (4)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Where [Where] inputs: [/encoder/3/upsample/Equal_output_0 -> (4)[BOOL]], [/encoder/3/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/3/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Where for ONNX node: /encoder/3/upsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Where_output_0 for ONNX tensor: /encoder/3/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Where [Where] outputs: [/encoder/3/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Expand [Expand] inputs: [/encoder/3/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 512)[FLOAT]], [/encoder/3/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Expand for ONNX node: /encoder/3/upsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Expand_output_0 for ONNX tensor: /encoder/3/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Expand [Expand] outputs: [/encoder/3/upsample/Expand_output_0 -> (-1, 8, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Constant_10 [Constant] outputs: [/encoder/3/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Mul_1 [Mul] inputs: [/encoder/3/upsample/Gather_output_0 -> ()[INT32]], [/encoder/3/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Constant_10_output_0 for ONNX node: /encoder/3/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Mul_1 for ONNX node: /encoder/3/upsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Mul_1_output_0 for ONNX tensor: /encoder/3/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Mul_1 [Mul] outputs: [/encoder/3/upsample/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5349 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5349 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5349 [Constant] outputs: [onnx::Unsqueeze_6475 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6475 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/3/upsample/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6475 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_4 for ONNX node: /encoder/3/upsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5351 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5351 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5351 [Constant] outputs: [onnx::Unsqueeze_6477 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6477 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/3/upsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6477 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_5 for ONNX node: /encoder/3/upsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5353 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5353 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5353 [Constant] outputs: [onnx::Unsqueeze_6479 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6479 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/3/upsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6479 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Unsqueeze_6 for ONNX node: /encoder/3/upsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/3/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/3/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Concat_1 [Concat] inputs: [/encoder/3/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/3/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/3/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Concat_1 for ONNX node: /encoder/3/upsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Concat_1_output_0 for ONNX tensor: /encoder/3/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Concat_1 [Concat] outputs: [/encoder/3/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/upsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Reshape_1 [Reshape] inputs: [/encoder/3/upsample/Expand_output_0 -> (-1, 8, -1, 512)[FLOAT]], [/encoder/3/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/upsample/Reshape_1 for ONNX node: /encoder/3/upsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/upsample/Reshape_1_output_0 for ONNX tensor: /encoder/3/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/upsample/Reshape_1 [Reshape] outputs: [/encoder/3/upsample/Reshape_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant [Constant] outputs: [/encoder/3/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_1 [Constant] outputs: [/encoder/3/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Unsqueeze [Unsqueeze] inputs: [/encoder/3/downsample/Gather_output_0 -> ()[INT32]], [/encoder/3/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/Unsqueeze for ONNX node: /encoder/3/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/Unsqueeze_output_0 for ONNX tensor: /encoder/3/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Unsqueeze [Unsqueeze] outputs: [/encoder/3/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_2 [Constant] outputs: [/encoder/3/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Constant_3 [Constant] outputs: [/encoder/3/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Slice [Slice] inputs: [/encoder/3/upsample/Reshape_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/Constant_output_0 -> (1)[INT32]], [/encoder/3/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/3/Constant_2_output_0 -> (1)[INT32]], [/encoder/3/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/Slice for ONNX node: /encoder/3/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/Slice_output_0 for ONNX tensor: /encoder/3/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/Slice [Slice] outputs: [/encoder/3/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/out_combiner/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Sub [Sub] inputs: [/encoder/3/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/out_combiner/Sub for ONNX node: /encoder/3/out_combiner/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/out_combiner/Sub_output_0 for ONNX tensor: /encoder/3/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Sub [Sub] outputs: [/encoder/3/out_combiner/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/out_combiner/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.3.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Mul [Mul] inputs: [/encoder/3/out_combiner/Sub_output_0 -> (-1, -1, 512)[FLOAT]], [encoder.encoders.3.out_combiner.bypass_scale -> (512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.3.out_combiner.bypass_scale for ONNX node: encoder.encoders.3.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/out_combiner/Mul for ONNX node: /encoder/3/out_combiner/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/out_combiner/Mul_output_0 for ONNX tensor: /encoder/3/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Mul [Mul] outputs: [/encoder/3/out_combiner/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/3/out_combiner/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Add [Add] inputs: [/encoder/Concat_5_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/3/out_combiner/Mul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/3/out_combiner/Add for ONNX node: /encoder/3/out_combiner/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/3/out_combiner/Add_output_0 for ONNX tensor: /encoder/3/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/3/out_combiner/Add [Add] outputs: [/encoder/3/out_combiner/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_28 [Constant] outputs: [/encoder/Constant_28_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_29 [Constant] outputs: [/encoder/Constant_29_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_30 [Constant] outputs: [/encoder/Constant_30_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_31 [Constant] outputs: [/encoder/Constant_31_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_4 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_4 [Slice] inputs: [/encoder/3/out_combiner/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/Constant_29_output_0 -> (1)[INT32]], [/encoder/Constant_30_output_0 -> (1)[INT32]], [/encoder/Constant_28_output_0 -> (1)[INT32]], [/encoder/Constant_31_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_4 for ONNX node: /encoder/Slice_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_4_output_0 for ONNX tensor: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_4 [Slice] outputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape [Shape] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Shape for ONNX node: /encoder/4/downsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Shape_output_0 for ONNX tensor: /encoder/4/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape [Shape] outputs: [/encoder/4/downsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant [Constant] outputs: [/encoder/4/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather [Gather] inputs: [/encoder/4/downsample/Shape_output_0 -> (3)[INT32]], [/encoder/4/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_output_0 for ONNX node: /encoder/4/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Gather for ONNX node: /encoder/4/downsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Gather_output_0 for ONNX tensor: /encoder/4/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather [Gather] outputs: [/encoder/4/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_1 [Shape] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Shape_1 for ONNX node: /encoder/4/downsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Shape_1_output_0 for ONNX tensor: /encoder/4/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_1 [Shape] outputs: [/encoder/4/downsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_1 [Constant] outputs: [/encoder/4/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather_1 [Gather] inputs: [/encoder/4/downsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_1_output_0 for ONNX node: /encoder/4/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Gather_1 for ONNX node: /encoder/4/downsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Gather_1_output_0 for ONNX tensor: /encoder/4/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather_1 [Gather] outputs: [/encoder/4/downsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_2 [Shape] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Shape_2 for ONNX node: /encoder/4/downsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Shape_2_output_0 for ONNX tensor: /encoder/4/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_2 [Shape] outputs: [/encoder/4/downsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_2 [Constant] outputs: [/encoder/4/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather_2 [Gather] inputs: [/encoder/4/downsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/4/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_2_output_0 for ONNX node: /encoder/4/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Gather_2 for ONNX node: /encoder/4/downsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Gather_2_output_0 for ONNX tensor: /encoder/4/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Gather_2 [Gather] outputs: [/encoder/4/downsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_3 [Constant] outputs: [/encoder/4/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Add [Add] inputs: [/encoder/4/downsample/Gather_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_3_output_0 for ONNX node: /encoder/4/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Add for ONNX node: /encoder/4/downsample/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Add_output_0 for ONNX tensor: /encoder/4/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Add [Add] outputs: [/encoder/4/downsample/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_4 [Constant] outputs: [/encoder/4/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub [Sub] inputs: [/encoder/4/downsample/Add_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_4_output_0 for ONNX node: /encoder/4/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Sub for ONNX node: /encoder/4/downsample/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Sub_output_0 for ONNX tensor: /encoder/4/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub [Sub] outputs: [/encoder/4/downsample/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_5 [Constant] outputs: [/encoder/4/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Div [Div] inputs: [/encoder/4/downsample/Sub_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_5_output_0 for ONNX node: /encoder/4/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Div for ONNX node: /encoder/4/downsample/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Div_output_0 for ONNX tensor: /encoder/4/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Div [Div] outputs: [/encoder/4/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Cast [Cast] inputs: [/encoder/4/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Cast for ONNX node: /encoder/4/downsample/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Cast_output_0 for ONNX tensor: /encoder/4/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Cast [Cast] outputs: [/encoder/4/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Cast_1 [Cast] inputs: [/encoder/4/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Cast_1 for ONNX node: /encoder/4/downsample/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Cast_1_output_0 for ONNX tensor: /encoder/4/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Cast_1 [Cast] outputs: [/encoder/4/downsample/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_6 [Constant] outputs: [/encoder/4/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul [Mul] inputs: [/encoder/4/downsample/Cast_1_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_6_output_0 for ONNX node: /encoder/4/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Mul for ONNX node: /encoder/4/downsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Mul_output_0 for ONNX tensor: /encoder/4/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul [Mul] outputs: [/encoder/4/downsample/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub_1 [Sub] inputs: [/encoder/4/downsample/Mul_output_0 -> ()[INT32]], [/encoder/4/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Sub_1 for ONNX node: /encoder/4/downsample/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Sub_1_output_0 for ONNX tensor: /encoder/4/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub_1 [Sub] outputs: [/encoder/4/downsample/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_7 [Constant] outputs: [/encoder/4/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub_2 [Sub] inputs: [/encoder/4/downsample/Gather_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_7_output_0 for ONNX node: /encoder/4/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Sub_2 for ONNX node: /encoder/4/downsample/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Sub_2_output_0 for ONNX tensor: /encoder/4/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Sub_2 [Sub] outputs: [/encoder/4/downsample/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_8 [Constant] outputs: [/encoder/4/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze [Unsqueeze] inputs: [/encoder/4/downsample/Sub_2_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze for ONNX node: /encoder/4/downsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_9 [Constant] outputs: [/encoder/4/downsample/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_10 [Constant] outputs: [/encoder/4/downsample/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_11 [Constant] outputs: [/encoder/4/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Slice [Slice] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/downsample/Constant_9_output_0 -> (1)[INT32]], [/encoder/4/downsample/Constant_10_output_0 -> (1)[INT32]], [/encoder/4/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Slice for ONNX node: /encoder/4/downsample/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Slice_output_0 for ONNX tensor: /encoder/4/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Slice [Slice] outputs: [/encoder/4/downsample/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_12 [Constant] outputs: [/encoder/4/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/downsample/Sub_1_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_1 for ONNX node: /encoder/4/downsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_13 [Constant] outputs: [/encoder/4/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/downsample/Gather_1_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_2 for ONNX node: /encoder/4/downsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_14 [Constant] outputs: [/encoder/4/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/downsample/Gather_2_output_0 -> ()[INT32]], [/encoder/4/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_3 for ONNX node: /encoder/4/downsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat [Concat] inputs: [/encoder/4/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Concat for ONNX node: /encoder/4/downsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Concat_output_0 for ONNX tensor: /encoder/4/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat [Concat] outputs: [/encoder/4/downsample/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_15 [Constant] outputs: [/encoder/4/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Reshape [Reshape] inputs: [/encoder/4/downsample/Concat_output_0 -> (3)[INT32]], [/encoder/4/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Reshape for ONNX node: /encoder/4/downsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Reshape_output_0 for ONNX tensor: /encoder/4/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Reshape [Reshape] outputs: [/encoder/4/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_3 [Shape] inputs: [/encoder/4/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Shape_3 for ONNX node: /encoder/4/downsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Shape_3_output_0 for ONNX tensor: /encoder/4/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Shape_3 [Shape] outputs: [/encoder/4/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/4/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/4/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/4/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_16 [Constant] outputs: [/encoder/4/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul_1 [Mul] inputs: [/encoder/4/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/4/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_16_output_0 for ONNX node: /encoder/4/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Mul_1 for ONNX node: /encoder/4/downsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Mul_1_output_0 for ONNX tensor: /encoder/4/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul_1 [Mul] outputs: [/encoder/4/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Equal [Equal] inputs: [/encoder/4/downsample/Reshape_output_0 -> (3)[INT32]], [/encoder/4/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Equal for ONNX node: /encoder/4/downsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Equal_output_0 for ONNX tensor: /encoder/4/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Equal [Equal] outputs: [/encoder/4/downsample/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Where [Where] inputs: [/encoder/4/downsample/Equal_output_0 -> (3)[BOOL]], [/encoder/4/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/4/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Where for ONNX node: /encoder/4/downsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Where_output_0 for ONNX tensor: /encoder/4/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Where [Where] outputs: [/encoder/4/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Expand [Expand] inputs: [/encoder/4/downsample/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Expand for ONNX node: /encoder/4/downsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Expand_output_0 for ONNX tensor: /encoder/4/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Expand [Expand] outputs: [/encoder/4/downsample/Expand_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat_1 [Concat] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/Expand_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Concat_1 for ONNX node: /encoder/4/downsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Concat_1_output_0 for ONNX tensor: /encoder/4/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat_1 [Concat] outputs: [/encoder/4/downsample/Concat_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5416 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5416 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5416 [Constant] outputs: [onnx::Unsqueeze_6546 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6546 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/downsample/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6546 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_4 for ONNX node: /encoder/4/downsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Constant_17 [Constant] outputs: [/encoder/4/downsample/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5419 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5419 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5419 [Constant] outputs: [onnx::Unsqueeze_6550 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6550 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/downsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6550 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_5 for ONNX node: /encoder/4/downsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5421 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5421 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5421 [Constant] outputs: [onnx::Unsqueeze_6552 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6552 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/downsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6552 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Unsqueeze_6 for ONNX node: /encoder/4/downsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat_2 [Concat] inputs: [/encoder/4/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/downsample/Constant_17_output_0 -> (1)[INT32]], [/encoder/4/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Constant_17_output_0 for ONNX node: /encoder/4/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Concat_2 for ONNX node: /encoder/4/downsample/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Concat_2_output_0 for ONNX tensor: /encoder/4/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Concat_2 [Concat] outputs: [/encoder/4/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Reshape_1 [Reshape] inputs: [/encoder/4/downsample/Concat_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Reshape_1 for ONNX node: /encoder/4/downsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Reshape_1_output_0 for ONNX tensor: /encoder/4/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Reshape_1 [Reshape] outputs: [/encoder/4/downsample/Reshape_1_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Softmax_9596 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Softmax [Softmax] inputs: [onnx::Softmax_9596 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::Softmax_9596 for ONNX node: onnx::Softmax_9596 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Softmax for ONNX node: /encoder/4/downsample/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Softmax_output_0 for ONNX tensor: /encoder/4/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Softmax [Softmax] outputs: [/encoder/4/downsample/Softmax_output_0 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul_2 [Mul] inputs: [/encoder/4/downsample/Reshape_1_output_0 -> (-1, 4, -1, 384)[FLOAT]], [/encoder/4/downsample/Softmax_output_0 -> (4, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/Mul_2 for ONNX node: /encoder/4/downsample/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/Mul_2_output_0 for ONNX tensor: /encoder/4/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/Mul_2 [Mul] outputs: [/encoder/4/downsample/Mul_2_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/downsample/ReduceSum [ReduceSum] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/ReduceSum [ReduceSum] inputs: [/encoder/4/downsample/Mul_2_output_0 -> (-1, 4, -1, 384)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/downsample/ReduceSum for ONNX node: /encoder/4/downsample/ReduceSum [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/downsample/ReduceSum_output_0 for ONNX tensor: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/downsample/ReduceSum [ReduceSum] outputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Shape [Shape] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Shape for ONNX node: /encoder/4/encoder/encoder_pos/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Shape [Shape] outputs: [/encoder/4/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_1 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Gather [Gather] inputs: [/encoder/4/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/4/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Gather for ONNX node: /encoder/4/encoder/encoder_pos/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Gather [Gather] outputs: [/encoder/4/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_2 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Sub [Sub] inputs: [/encoder/4/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/4/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/4/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Sub for ONNX node: /encoder/4/encoder/encoder_pos/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Sub [Sub] outputs: [/encoder/4/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_3 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Add [Add] inputs: [/encoder/4/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/4/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/4/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Add for ONNX node: /encoder/4/encoder/encoder_pos/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Add_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Add [Add] outputs: [/encoder/4/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_4 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Add_1 [Add] inputs: [/encoder/4/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/4/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/4/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Add_1 for ONNX node: /encoder/4/encoder/encoder_pos/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Add_1 [Add] outputs: [/encoder/4/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_5 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/4/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Unsqueeze for ONNX node: /encoder/4/encoder/encoder_pos/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_6 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/4/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/4/encoder/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_7 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_8 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Slice [Slice] inputs: [/encoder/4/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/4/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Constant_output_0 for ONNX node: /encoder/4/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Slice for ONNX node: /encoder/4/encoder/encoder_pos/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Slice [Slice] outputs: [/encoder/4/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Constant_9 [Constant] outputs: [/encoder/4/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/4/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/4/encoder/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9598 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9598 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9598 for ONNX node: onnx::MatMul_9598 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/in_proj/Add for ONNX node: /encoder/4/encoder/0/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice [Slice] inputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Slice for ONNX node: /encoder/4/encoder/0/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice [Slice] outputs: [/encoder/4/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Slice_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/4/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/4/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Slice_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/4/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5470 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5470 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5470 [Constant] outputs: [onnx::Unsqueeze_6607 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6607 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6607 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5472 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5472 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5472 [Constant] outputs: [onnx::Unsqueeze_6609 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6609 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6609 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5477 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5477 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5477 [Constant] outputs: [onnx::Unsqueeze_6616 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6616 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6616 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5479 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5479 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5479 [Constant] outputs: [onnx::Unsqueeze_6618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6618 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6618 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5485 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5485 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5485 [Constant] outputs: [onnx::Unsqueeze_6626 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6626 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6626 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5487 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5487 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5487 [Constant] outputs: [onnx::Unsqueeze_6628 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6628 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6628 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Transpose for ONNX node: /encoder/4/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Transpose_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Transpose_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/MatMul for ONNX node: /encoder/4/encoder/0/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9605 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9605 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9605 for ONNX node: onnx::MatMul_9605 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Mul [Mul] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Mul for ONNX node: /encoder/4/encoder/0/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Mul [Mul] outputs: [/encoder/4/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Sub [Sub] inputs: [/encoder/4/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Sub for ONNX node: /encoder/4/encoder/0/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Sub [Sub] outputs: [/encoder/4/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5504 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5504 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5504 [Constant] outputs: [onnx::Unsqueeze_6649 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6649 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_6649 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Transpose_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/4/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/MatMul_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather_3 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_4 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather_4 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_5 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Gather_5 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/4/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Sub_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast [Cast] inputs: [/encoder/4/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Cast for ONNX node: /encoder/4/encoder/0/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast [Cast] outputs: [/encoder/4/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Range [Range] inputs: [/encoder/4/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Range for ONNX node: /encoder/4/encoder/0/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Range [Range] outputs: [/encoder/4/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Cast_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/4/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Range_1 [Range] inputs: [/encoder/4/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Range_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Range_1 [Range] outputs: [/encoder/4/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Mul_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5535 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5535 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5535 [Constant] outputs: [onnx::Unsqueeze_6682 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6682 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6682 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_4 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5538 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5538 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5538 [Constant] outputs: [onnx::Unsqueeze_6685 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6685 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6685 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_5 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Shape_6 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/4/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/4/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/4/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Expand [Expand] inputs: [/encoder/4/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Expand for ONNX node: /encoder/4/encoder/0/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Expand [Expand] outputs: [/encoder/4/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Tile [Tile] inputs: [/encoder/4/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Tile for ONNX node: /encoder/4/encoder/0/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Tile [Tile] outputs: [/encoder/4/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Add [Add] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Add for ONNX node: /encoder/4/encoder/0/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Add [Add] outputs: [/encoder/4/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5549 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5549 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5549 [Constant] outputs: [onnx::Unsqueeze_6697 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6697 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_6697 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_6 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape_4 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/GatherElements for ONNX node: /encoder/4/encoder/0/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/4/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5554 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5554 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5554 [Constant] outputs: [onnx::Unsqueeze_6702 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6702 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6702 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5556 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5556 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5556 [Constant] outputs: [onnx::Unsqueeze_6704 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6704 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6704 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5558 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5558 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5558 [Constant] outputs: [onnx::Unsqueeze_6706 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6706 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6706 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5560 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5560 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5560 [Constant] outputs: [onnx::Unsqueeze_6708 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6708 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6708 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Concat_7 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/4/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/4/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Reshape_5 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/4/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Add_1 [Add] inputs: [/encoder/4/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Add_1 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Add_1 [Add] outputs: [/encoder/4/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Cast_2 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/4/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Where [Where] inputs: [/encoder/4/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/4/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Where for ONNX node: /encoder/4/encoder/0/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Where [Where] outputs: [/encoder/4/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/4/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn_weights/Softmax for ONNX node: /encoder/4/encoder/0/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/4/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9612 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9612 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9612 for ONNX node: onnx::MatMul_9612 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/in_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Sub for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Exp for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Log for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Cast for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Equal for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Where for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Mul for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9613 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9613 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9613 for ONNX node: onnx::MatMul_9613 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add [Add] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add for ONNX node: /encoder/4/encoder/0/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add [Add] outputs: [/encoder/4/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant [Constant] outputs: [/encoder/4/encoder/0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Slice [Slice] inputs: [/encoder/4/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/Constant_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Slice for ONNX node: /encoder/4/encoder/0/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Slice_output_0 for ONNX tensor: /encoder/4/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Slice [Slice] outputs: [/encoder/4/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9614 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9614 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9614 for ONNX node: onnx::MatMul_9614 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/in_proj/Add for ONNX node: /encoder/4/encoder/0/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape [Shape] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Add [Add] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Add for ONNX node: /encoder/4/encoder/0/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Add [Add] outputs: [/encoder/4/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Div [Div] inputs: [/encoder/4/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Div for ONNX node: /encoder/4/encoder/0/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Div [Div] outputs: [/encoder/4/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul [Mul] inputs: [/encoder/4/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Mul for ONNX node: /encoder/4/encoder/0/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul [Mul] outputs: [/encoder/4/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice [Slice] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Slice for ONNX node: /encoder/4/encoder/0/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice [Slice] outputs: [/encoder/4/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/4/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Mul_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Slice_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/4/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/4/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Mul_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/4/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/4/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Slice_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/4/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/4/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/4/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5622 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5622 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5622 [Constant] outputs: [onnx::Unsqueeze_6773 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6773 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6773 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5624 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5624 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5624 [Constant] outputs: [onnx::Unsqueeze_6775 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6775 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6775 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat [Concat] inputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Concat for ONNX node: /encoder/4/encoder/0/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat [Concat] outputs: [/encoder/4/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Reshape for ONNX node: /encoder/4/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/4/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/4/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Mul_3 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape_3 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather_3 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape_4 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather_4 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/4/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Shape_5 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/4/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/4/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Gather_5 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/4/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5639 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5639 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5639 [Constant] outputs: [onnx::Unsqueeze_6791 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6791 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6791 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5641 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5641 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5641 [Constant] outputs: [onnx::Unsqueeze_6793 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6793 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6793 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5643 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5643 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5643 [Constant] outputs: [onnx::Unsqueeze_6795 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6795 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_6795 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Concat_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/4/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Reshape_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/4/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Transpose for ONNX node: /encoder/4/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/4/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/MatMul for ONNX node: /encoder/4/encoder/0/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/4/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Transpose_1 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5651 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5651 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5651 [Constant] outputs: [onnx::Unsqueeze_6804 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6804 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_6804 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5653 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5653 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5653 [Constant] outputs: [onnx::Unsqueeze_6806 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6806 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_6806 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/4/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Concat_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/4/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Reshape_2 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/4/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/Mul_4 for ONNX node: /encoder/4/encoder/0/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/4/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9618 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9618 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9618 for ONNX node: onnx::MatMul_9618 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/nonlin_attention/out_proj/Add for ONNX node: /encoder/4/encoder/0/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_1 [Add] inputs: [/encoder/4/encoder/0/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_1 for ONNX node: /encoder/4/encoder/0/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_1 [Add] outputs: [/encoder/4/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape [Shape] inputs: [/encoder/4/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Shape for ONNX node: /encoder/4/encoder/0/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape [Shape] outputs: [/encoder/4/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant [Constant] outputs: [/encoder/4/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather [Gather] inputs: [/encoder/4/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Constant_output_0 for ONNX node: /encoder/4/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Gather for ONNX node: /encoder/4/encoder/0/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather [Gather] outputs: [/encoder/4/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Shape_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_1 [Gather] inputs: [/encoder/4/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Gather_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_1 [Gather] outputs: [/encoder/4/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_2 [Shape] inputs: [/encoder/4/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Shape_2 for ONNX node: /encoder/4/encoder/0/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_2 [Shape] outputs: [/encoder/4/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_2 [Gather] inputs: [/encoder/4/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Gather_2 for ONNX node: /encoder/4/encoder/0/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_2 [Gather] outputs: [/encoder/4/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9619 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9619 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9619 for ONNX node: onnx::MatMul_9619 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/in_proj/Add for ONNX node: /encoder/4/encoder/0/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5673 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5673 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5673 [Constant] outputs: [onnx::Unsqueeze_6829 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6829 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6829 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5675 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5675 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5675 [Constant] outputs: [onnx::Unsqueeze_6831 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6831 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6831 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5677 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5677 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5677 [Constant] outputs: [onnx::Unsqueeze_6833 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6833 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6833 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Concat [Concat] inputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Concat for ONNX node: /encoder/4/encoder/0/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Concat [Concat] outputs: [/encoder/4/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Reshape [Reshape] inputs: [/encoder/4/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Reshape for ONNX node: /encoder/4/encoder/0/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Reshape [Reshape] outputs: [/encoder/4/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Transpose [Transpose] inputs: [/encoder/4/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Transpose for ONNX node: /encoder/4/encoder/0/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Transpose [Transpose] outputs: [/encoder/4/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_3 [Shape] inputs: [/encoder/4/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Shape_3 for ONNX node: /encoder/4/encoder/0/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Shape_3 [Shape] outputs: [/encoder/4/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_3 [Gather] inputs: [/encoder/4/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Gather_3 for ONNX node: /encoder/4/encoder/0/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Gather_3 [Gather] outputs: [/encoder/4/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/MatMul [MatMul] inputs: [/encoder/4/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/MatMul for ONNX node: /encoder/4/encoder/0/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Transpose_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Mul [Mul] inputs: [/encoder/4/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Mul for ONNX node: /encoder/4/encoder/0/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Mul [Mul] outputs: [/encoder/4/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5689 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5689 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5689 [Constant] outputs: [onnx::Unsqueeze_6846 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6846 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6846 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5691 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5691 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5691 [Constant] outputs: [onnx::Unsqueeze_6848 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6848 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6848 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5693 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5693 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5693 [Constant] outputs: [onnx::Unsqueeze_6850 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6850 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_6850 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/4/encoder/0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Concat_1 [Concat] inputs: [/encoder/4/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Concat_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Concat_1 [Concat] outputs: [/encoder/4/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/Reshape_1 for ONNX node: /encoder/4/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9621 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9621 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9621 for ONNX node: onnx::MatMul_9621 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn1/out_proj/Add for ONNX node: /encoder/4/encoder/0/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn1/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_2 [Add] inputs: [/encoder/4/encoder/0/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_2 for ONNX node: /encoder/4/encoder/0/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_2_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_2 [Add] outputs: [/encoder/4/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9622 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9622 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9622 for ONNX node: onnx::MatMul_9622 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/in_proj/Add for ONNX node: /encoder/4/encoder/0/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Shape [Shape] inputs: [/encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Shape for ONNX node: /encoder/4/encoder/0/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Shape [Shape] outputs: [/encoder/4/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Gather [Gather] inputs: [/encoder/4/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Gather for ONNX node: /encoder/4/encoder/0/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Gather [Gather] outputs: [/encoder/4/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Add [Add] inputs: [/encoder/4/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Add for ONNX node: /encoder/4/encoder/0/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Add [Add] outputs: [/encoder/4/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Div [Div] inputs: [/encoder/4/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Div for ONNX node: /encoder/4/encoder/0/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Div_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Div [Div] outputs: [/encoder/4/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul [Mul] inputs: [/encoder/4/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Mul for ONNX node: /encoder/4/encoder/0/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul [Mul] outputs: [/encoder/4/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Slice [Slice] inputs: [/encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Slice for ONNX node: /encoder/4/encoder/0/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Slice [Slice] outputs: [/encoder/4/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_5 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul_1 [Mul] inputs: [/encoder/4/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Mul_1 for ONNX node: /encoder/4/encoder/0/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul_1 [Mul] outputs: [/encoder/4/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Slice_1 [Slice] inputs: [/encoder/4/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Slice_1 for ONNX node: /encoder/4/encoder/0/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Slice_1 [Slice] outputs: [/encoder/4/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul_2 [Mul] inputs: [/encoder/4/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Mul_2 for ONNX node: /encoder/4/encoder/0/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Mul_2 [Mul] outputs: [/encoder/4/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Transpose [Transpose] inputs: [/encoder/4/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Transpose for ONNX node: /encoder/4/encoder/0/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Transpose [Transpose] outputs: [/encoder/4/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Shape_1 for ONNX node: /encoder/4/encoder/0/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Expand for ONNX node: /encoder/4/encoder/0/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Expand [Expand] outputs: [/encoder/4/encoder/0/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Cast [Cast] inputs: [/encoder/4/encoder/0/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Cast for ONNX node: /encoder/4/encoder/0/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Cast [Cast] outputs: [/encoder/4/encoder/0/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Constant_6 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Where [Where] inputs: [/encoder/4/encoder/0/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/0/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Where for ONNX node: /encoder/4/encoder/0/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Where [Where] outputs: [/encoder/4/encoder/0/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/0/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.0.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/Transpose_1 for ONNX node: /encoder/4/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Sub for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Exp for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Add [Add] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Add for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Log [Log] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Log for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Log [Log] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Cast for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Equal for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Where [Where] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Where for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Where [Where] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Mul for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9623 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9623 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9623 for ONNX node: onnx::MatMul_9623 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_3 [Add] inputs: [/encoder/4/encoder/0/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_3 for ONNX node: /encoder/4/encoder/0/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_3_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_3 [Add] outputs: [/encoder/4/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9624 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9624 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9624 for ONNX node: onnx::MatMul_9624 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/in_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Sub for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Exp for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Log for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Cast for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Equal for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Where for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Mul for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9625 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9625 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9625 for ONNX node: onnx::MatMul_9625 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_4 [Add] inputs: [/encoder/4/encoder/0/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_4 for ONNX node: /encoder/4/encoder/0/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_4_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_4 [Add] outputs: [/encoder/4/encoder/0/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Sub [Sub] inputs: [/encoder/4/encoder/0/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass_mid/Sub for ONNX node: /encoder/4/encoder/0/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Sub [Sub] outputs: [/encoder/4/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Mul [Mul] inputs: [/encoder/4/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass_mid/Mul for ONNX node: /encoder/4/encoder/0/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Mul [Mul] outputs: [/encoder/4/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Add [Add] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass_mid/Add for ONNX node: /encoder/4/encoder/0/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass_mid/Add [Add] outputs: [/encoder/4/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape [Shape] inputs: [/encoder/4/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Shape for ONNX node: /encoder/4/encoder/0/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape [Shape] outputs: [/encoder/4/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant [Constant] outputs: [/encoder/4/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather [Gather] inputs: [/encoder/4/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Constant_output_0 for ONNX node: /encoder/4/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Gather for ONNX node: /encoder/4/encoder/0/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather [Gather] outputs: [/encoder/4/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Shape_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather_1 [Gather] inputs: [/encoder/4/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Gather_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather_1 [Gather] outputs: [/encoder/4/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9626 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9626 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9626 for ONNX node: onnx::MatMul_9626 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/in_proj/Add for ONNX node: /encoder/4/encoder/0/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5775 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5775 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5775 [Constant] outputs: [onnx::Unsqueeze_6938 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6938 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6938 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5777 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5777 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5777 [Constant] outputs: [onnx::Unsqueeze_6940 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6940 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6940 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5779 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5779 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5779 [Constant] outputs: [onnx::Unsqueeze_6942 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6942 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_6942 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Concat [Concat] inputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Concat for ONNX node: /encoder/4/encoder/0/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Concat [Concat] outputs: [/encoder/4/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Reshape [Reshape] inputs: [/encoder/4/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Reshape for ONNX node: /encoder/4/encoder/0/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Reshape [Reshape] outputs: [/encoder/4/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Transpose [Transpose] inputs: [/encoder/4/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Transpose for ONNX node: /encoder/4/encoder/0/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Transpose [Transpose] outputs: [/encoder/4/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape_2 [Shape] inputs: [/encoder/4/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Shape_2 for ONNX node: /encoder/4/encoder/0/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Shape_2 [Shape] outputs: [/encoder/4/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather_2 [Gather] inputs: [/encoder/4/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Gather_2 for ONNX node: /encoder/4/encoder/0/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Gather_2 [Gather] outputs: [/encoder/4/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/MatMul [MatMul] inputs: [/encoder/4/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/MatMul for ONNX node: /encoder/4/encoder/0/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Transpose_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Mul [Mul] inputs: [/encoder/4/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Mul for ONNX node: /encoder/4/encoder/0/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Mul [Mul] outputs: [/encoder/4/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5791 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5791 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5791 [Constant] outputs: [onnx::Unsqueeze_6955 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6955 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_6955 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5793 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5793 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5793 [Constant] outputs: [onnx::Unsqueeze_6957 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6957 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_6957 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5795 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5795 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5795 [Constant] outputs: [onnx::Unsqueeze_6959 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_6959 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_6959 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/4/encoder/0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Concat_1 [Concat] inputs: [/encoder/4/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Concat_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Concat_1 [Concat] outputs: [/encoder/4/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/Reshape_1 for ONNX node: /encoder/4/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9628 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9628 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9628 for ONNX node: onnx::MatMul_9628 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/self_attn2/out_proj/Add for ONNX node: /encoder/4/encoder/0/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/self_attn2/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_5 [Add] inputs: [/encoder/4/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_5 for ONNX node: /encoder/4/encoder/0/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_5_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_5 [Add] outputs: [/encoder/4/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9629 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9629 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9629 for ONNX node: onnx::MatMul_9629 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/in_proj/Add for ONNX node: /encoder/4/encoder/0/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Shape [Shape] inputs: [/encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Shape for ONNX node: /encoder/4/encoder/0/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Shape [Shape] outputs: [/encoder/4/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Gather [Gather] inputs: [/encoder/4/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Gather for ONNX node: /encoder/4/encoder/0/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Gather [Gather] outputs: [/encoder/4/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Add [Add] inputs: [/encoder/4/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Add for ONNX node: /encoder/4/encoder/0/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Add [Add] outputs: [/encoder/4/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Div [Div] inputs: [/encoder/4/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Div for ONNX node: /encoder/4/encoder/0/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Div_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Div [Div] outputs: [/encoder/4/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul [Mul] inputs: [/encoder/4/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Mul for ONNX node: /encoder/4/encoder/0/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul [Mul] outputs: [/encoder/4/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Slice [Slice] inputs: [/encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Slice for ONNX node: /encoder/4/encoder/0/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Slice [Slice] outputs: [/encoder/4/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_5 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul_1 [Mul] inputs: [/encoder/4/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Mul_1 for ONNX node: /encoder/4/encoder/0/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul_1 [Mul] outputs: [/encoder/4/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Slice_1 [Slice] inputs: [/encoder/4/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Slice_1 for ONNX node: /encoder/4/encoder/0/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Slice_1 [Slice] outputs: [/encoder/4/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul_2 [Mul] inputs: [/encoder/4/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Mul_2 for ONNX node: /encoder/4/encoder/0/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Mul_2 [Mul] outputs: [/encoder/4/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Transpose [Transpose] inputs: [/encoder/4/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Transpose for ONNX node: /encoder/4/encoder/0/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Transpose [Transpose] outputs: [/encoder/4/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Shape_1 [Shape] inputs: [/encoder/4/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Shape_1 for ONNX node: /encoder/4/encoder/0/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Shape_1 [Shape] outputs: [/encoder/4/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Expand for ONNX node: /encoder/4/encoder/0/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Expand [Expand] outputs: [/encoder/4/encoder/0/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Cast [Cast] inputs: [/encoder/4/encoder/0/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Cast for ONNX node: /encoder/4/encoder/0/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Cast [Cast] outputs: [/encoder/4/encoder/0/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Constant_6 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Where [Where] inputs: [/encoder/4/encoder/0/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/0/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Where for ONNX node: /encoder/4/encoder/0/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Where [Where] outputs: [/encoder/4/encoder/0/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/0/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.0.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/Transpose_1 for ONNX node: /encoder/4/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Sub for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Exp for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Add [Add] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Add for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Log [Log] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Log for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Log [Log] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Cast for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Equal for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Where [Where] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Where for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Where [Where] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Mul for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9630 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9630 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9630 for ONNX node: onnx::MatMul_9630 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_6 [Add] inputs: [/encoder/4/encoder/0/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_6 for ONNX node: /encoder/4/encoder/0/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_6_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_6 [Add] outputs: [/encoder/4/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9631 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9631 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9631 for ONNX node: onnx::MatMul_9631 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/in_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Sub for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Exp for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Add for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Log for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Cast for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Equal for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Where for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Mul for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9632 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9632 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9632 for ONNX node: onnx::MatMul_9632 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_7 [Add] inputs: [/encoder/4/encoder/0/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/Add_7 for ONNX node: /encoder/4/encoder/0/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/Add_7_output_0 for ONNX tensor: /encoder/4/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/Add_7 [Add] outputs: [/encoder/4/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Sub [Sub] inputs: [/encoder/4/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.0.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.norm.bias for ONNX node: encoder.encoders.4.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Sub for ONNX node: /encoder/4/encoder/0/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Sub [Sub] outputs: [/encoder/4/encoder/0/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Constant [Constant] outputs: [/encoder/4/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Pow [Pow] inputs: [/encoder/4/encoder/0/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Constant_output_0 for ONNX node: /encoder/4/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Pow for ONNX node: /encoder/4/encoder/0/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Pow_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Pow [Pow] outputs: [/encoder/4/encoder/0/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/ReduceMean [ReduceMean] inputs: [/encoder/4/encoder/0/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/ReduceMean for ONNX node: /encoder/4/encoder/0/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/ReduceMean [ReduceMean] outputs: [/encoder/4/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Constant_1 [Constant] outputs: [/encoder/4/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Pow_1 [Pow] inputs: [/encoder/4/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Constant_1_output_0 for ONNX node: /encoder/4/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Pow_1 for ONNX node: /encoder/4/encoder/0/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Pow_1_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Pow_1 [Pow] outputs: [/encoder/4/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Exp [Exp] inputs: [encoder.encoders.4.encoder.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.norm.log_scale for ONNX node: encoder.encoders.4.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Exp for ONNX node: /encoder/4/encoder/0/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Exp_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Exp [Exp] outputs: [/encoder/4/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Mul [Mul] inputs: [/encoder/4/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Mul for ONNX node: /encoder/4/encoder/0/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Mul [Mul] outputs: [/encoder/4/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Mul_1 [Mul] inputs: [/encoder/4/encoder/0/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/norm/Mul_1 for ONNX node: /encoder/4/encoder/0/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/norm/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/norm/Mul_1 [Mul] outputs: [/encoder/4/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Sub [Sub] inputs: [/encoder/4/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass/Sub for ONNX node: /encoder/4/encoder/0/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass/Sub_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Sub [Sub] outputs: [/encoder/4/encoder/0/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Mul [Mul] inputs: [/encoder/4/encoder/0/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.0.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass/Mul for ONNX node: /encoder/4/encoder/0/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass/Mul_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Mul [Mul] outputs: [/encoder/4/encoder/0/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/0/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Add [Add] inputs: [/encoder/4/downsample/ReduceSum_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/0/bypass/Add for ONNX node: /encoder/4/encoder/0/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/0/bypass/Add_output_0 for ONNX tensor: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/0/bypass/Add [Add] outputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9633 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9633 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9633 for ONNX node: onnx::MatMul_9633 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/in_proj/Add for ONNX node: /encoder/4/encoder/1/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice [Slice] inputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Slice for ONNX node: /encoder/4/encoder/1/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice [Slice] outputs: [/encoder/4/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Slice_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/4/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/4/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Slice_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/4/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5901 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5901 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5901 [Constant] outputs: [onnx::Unsqueeze_7071 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7071 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7071 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5903 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5903 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5903 [Constant] outputs: [onnx::Unsqueeze_7073 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7073 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7073 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5908 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5908 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5908 [Constant] outputs: [onnx::Unsqueeze_7080 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7080 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7080 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5910 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5910 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5910 [Constant] outputs: [onnx::Unsqueeze_7082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7082 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7082 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5916 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5916 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5916 [Constant] outputs: [onnx::Unsqueeze_7090 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7090 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7090 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5918 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5918 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5918 [Constant] outputs: [onnx::Unsqueeze_7092 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7092 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7092 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Transpose for ONNX node: /encoder/4/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Transpose_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Transpose_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/MatMul for ONNX node: /encoder/4/encoder/1/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9640 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9640 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9640 for ONNX node: onnx::MatMul_9640 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Mul [Mul] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Mul for ONNX node: /encoder/4/encoder/1/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Mul [Mul] outputs: [/encoder/4/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Sub [Sub] inputs: [/encoder/4/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Sub for ONNX node: /encoder/4/encoder/1/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Sub [Sub] outputs: [/encoder/4/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5935 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5935 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5935 [Constant] outputs: [onnx::Unsqueeze_7113 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7113 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_7113 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Transpose_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/4/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/MatMul_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather_3 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_4 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather_4 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_5 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Gather_5 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/4/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Sub_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast [Cast] inputs: [/encoder/4/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Cast for ONNX node: /encoder/4/encoder/1/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast [Cast] outputs: [/encoder/4/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Range [Range] inputs: [/encoder/4/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Range for ONNX node: /encoder/4/encoder/1/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Range [Range] outputs: [/encoder/4/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Cast_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/4/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Range_1 [Range] inputs: [/encoder/4/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Range_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Range_1 [Range] outputs: [/encoder/4/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Mul_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5966 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5966 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5966 [Constant] outputs: [onnx::Unsqueeze_7146 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7146 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7146 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_4 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5969 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5969 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5969 [Constant] outputs: [onnx::Unsqueeze_7149 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7149 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7149 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_5 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Shape_6 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/4/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/4/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/4/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Expand [Expand] inputs: [/encoder/4/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Expand for ONNX node: /encoder/4/encoder/1/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Expand [Expand] outputs: [/encoder/4/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Tile [Tile] inputs: [/encoder/4/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Tile for ONNX node: /encoder/4/encoder/1/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Tile [Tile] outputs: [/encoder/4/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Add [Add] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Add for ONNX node: /encoder/4/encoder/1/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Add [Add] outputs: [/encoder/4/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5980 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5980 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5980 [Constant] outputs: [onnx::Unsqueeze_7161 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7161 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_7161 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_6 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape_4 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/GatherElements for ONNX node: /encoder/4/encoder/1/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/4/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5985 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5985 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5985 [Constant] outputs: [onnx::Unsqueeze_7166 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7166 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7166 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5987 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5987 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5987 [Constant] outputs: [onnx::Unsqueeze_7168 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7168 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7168 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5989 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5989 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5989 [Constant] outputs: [onnx::Unsqueeze_7170 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7170 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7170 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_5991 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_5991 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_5991 [Constant] outputs: [onnx::Unsqueeze_7172 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7172 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7172 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Concat_7 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/4/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/4/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Reshape_5 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/4/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Add_1 [Add] inputs: [/encoder/4/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Add_1 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Add_1 [Add] outputs: [/encoder/4/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Cast_2 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/4/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Where [Where] inputs: [/encoder/4/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/4/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Where for ONNX node: /encoder/4/encoder/1/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Where [Where] outputs: [/encoder/4/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/4/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn_weights/Softmax for ONNX node: /encoder/4/encoder/1/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/4/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9647 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9647 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9647 for ONNX node: onnx::MatMul_9647 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/in_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Sub for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Exp for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Log for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Cast for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Equal for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Where for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Mul for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9648 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9648 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9648 for ONNX node: onnx::MatMul_9648 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add [Add] inputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add for ONNX node: /encoder/4/encoder/1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add [Add] outputs: [/encoder/4/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant [Constant] outputs: [/encoder/4/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Slice [Slice] inputs: [/encoder/4/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Slice for ONNX node: /encoder/4/encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Slice_output_0 for ONNX tensor: /encoder/4/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Slice [Slice] outputs: [/encoder/4/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9649 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9649 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9649 for ONNX node: onnx::MatMul_9649 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/in_proj/Add for ONNX node: /encoder/4/encoder/1/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape [Shape] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Add [Add] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Add for ONNX node: /encoder/4/encoder/1/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Add [Add] outputs: [/encoder/4/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Div [Div] inputs: [/encoder/4/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Div for ONNX node: /encoder/4/encoder/1/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Div [Div] outputs: [/encoder/4/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul [Mul] inputs: [/encoder/4/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Mul for ONNX node: /encoder/4/encoder/1/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul [Mul] outputs: [/encoder/4/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice [Slice] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Slice for ONNX node: /encoder/4/encoder/1/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice [Slice] outputs: [/encoder/4/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/4/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Mul_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Slice_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/4/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/4/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Mul_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/4/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/4/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Slice_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/4/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/4/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/4/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6053 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6053 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6053 [Constant] outputs: [onnx::Unsqueeze_7237 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7237 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7237 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6055 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6055 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6055 [Constant] outputs: [onnx::Unsqueeze_7239 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7239 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7239 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat [Concat] inputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Concat for ONNX node: /encoder/4/encoder/1/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat [Concat] outputs: [/encoder/4/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Reshape for ONNX node: /encoder/4/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/4/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/4/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Mul_3 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape_3 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather_3 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape_4 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather_4 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/4/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Shape_5 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/4/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/4/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Gather_5 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/4/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6070 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6070 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6070 [Constant] outputs: [onnx::Unsqueeze_7255 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7255 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7255 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6072 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6072 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6072 [Constant] outputs: [onnx::Unsqueeze_7257 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7257 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7257 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6074 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6074 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6074 [Constant] outputs: [onnx::Unsqueeze_7259 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7259 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_7259 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Concat_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/4/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Reshape_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/4/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Transpose for ONNX node: /encoder/4/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/4/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/MatMul for ONNX node: /encoder/4/encoder/1/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/4/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Transpose_1 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6082 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6082 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6082 [Constant] outputs: [onnx::Unsqueeze_7268 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7268 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7268 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6084 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6084 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6084 [Constant] outputs: [onnx::Unsqueeze_7270 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7270 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7270 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/4/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Concat_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/4/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Reshape_2 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/4/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/Mul_4 for ONNX node: /encoder/4/encoder/1/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/4/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9653 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9653 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9653 for ONNX node: onnx::MatMul_9653 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/nonlin_attention/out_proj/Add for ONNX node: /encoder/4/encoder/1/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_1 [Add] inputs: [/encoder/4/encoder/1/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_1 for ONNX node: /encoder/4/encoder/1/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_1 [Add] outputs: [/encoder/4/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape [Shape] inputs: [/encoder/4/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Shape for ONNX node: /encoder/4/encoder/1/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape [Shape] outputs: [/encoder/4/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant [Constant] outputs: [/encoder/4/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather [Gather] inputs: [/encoder/4/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Constant_output_0 for ONNX node: /encoder/4/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Gather for ONNX node: /encoder/4/encoder/1/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather [Gather] outputs: [/encoder/4/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Shape_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_1 [Gather] inputs: [/encoder/4/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Gather_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_1 [Gather] outputs: [/encoder/4/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_2 [Shape] inputs: [/encoder/4/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Shape_2 for ONNX node: /encoder/4/encoder/1/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_2 [Shape] outputs: [/encoder/4/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_2 [Gather] inputs: [/encoder/4/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Gather_2 for ONNX node: /encoder/4/encoder/1/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_2 [Gather] outputs: [/encoder/4/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9654 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9654 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9654 for ONNX node: onnx::MatMul_9654 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/in_proj/Add for ONNX node: /encoder/4/encoder/1/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6104 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6104 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6104 [Constant] outputs: [onnx::Unsqueeze_7293 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7293 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7293 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6106 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6106 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6106 [Constant] outputs: [onnx::Unsqueeze_7295 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7295 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7295 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6108 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6108 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6108 [Constant] outputs: [onnx::Unsqueeze_7297 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7297 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7297 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Concat [Concat] inputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Concat for ONNX node: /encoder/4/encoder/1/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Concat [Concat] outputs: [/encoder/4/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Reshape [Reshape] inputs: [/encoder/4/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Reshape for ONNX node: /encoder/4/encoder/1/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Reshape [Reshape] outputs: [/encoder/4/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Transpose [Transpose] inputs: [/encoder/4/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Transpose for ONNX node: /encoder/4/encoder/1/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Transpose [Transpose] outputs: [/encoder/4/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_3 [Shape] inputs: [/encoder/4/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Shape_3 for ONNX node: /encoder/4/encoder/1/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Shape_3 [Shape] outputs: [/encoder/4/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_3 [Gather] inputs: [/encoder/4/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Gather_3 for ONNX node: /encoder/4/encoder/1/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Gather_3 [Gather] outputs: [/encoder/4/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/MatMul [MatMul] inputs: [/encoder/4/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/MatMul for ONNX node: /encoder/4/encoder/1/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Transpose_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Mul [Mul] inputs: [/encoder/4/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Mul for ONNX node: /encoder/4/encoder/1/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Mul [Mul] outputs: [/encoder/4/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6120 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6120 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6120 [Constant] outputs: [onnx::Unsqueeze_7310 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7310 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7310 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6122 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6122 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6122 [Constant] outputs: [onnx::Unsqueeze_7312 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7312 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7312 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6124 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6124 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6124 [Constant] outputs: [onnx::Unsqueeze_7314 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7314 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_7314 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/4/encoder/1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Concat_1 [Concat] inputs: [/encoder/4/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Concat_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Concat_1 [Concat] outputs: [/encoder/4/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/Reshape_1 for ONNX node: /encoder/4/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9656 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9656 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9656 for ONNX node: onnx::MatMul_9656 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn1/out_proj/Add for ONNX node: /encoder/4/encoder/1/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn1/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_2 [Add] inputs: [/encoder/4/encoder/1/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_2 for ONNX node: /encoder/4/encoder/1/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_2_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_2 [Add] outputs: [/encoder/4/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9657 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9657 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9657 for ONNX node: onnx::MatMul_9657 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/in_proj/Add for ONNX node: /encoder/4/encoder/1/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Shape [Shape] inputs: [/encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Shape for ONNX node: /encoder/4/encoder/1/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Shape [Shape] outputs: [/encoder/4/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Gather [Gather] inputs: [/encoder/4/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Gather for ONNX node: /encoder/4/encoder/1/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Gather [Gather] outputs: [/encoder/4/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Add [Add] inputs: [/encoder/4/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Add for ONNX node: /encoder/4/encoder/1/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Add [Add] outputs: [/encoder/4/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Div [Div] inputs: [/encoder/4/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Div for ONNX node: /encoder/4/encoder/1/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Div_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Div [Div] outputs: [/encoder/4/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul [Mul] inputs: [/encoder/4/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Mul for ONNX node: /encoder/4/encoder/1/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul [Mul] outputs: [/encoder/4/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Slice [Slice] inputs: [/encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Slice for ONNX node: /encoder/4/encoder/1/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Slice [Slice] outputs: [/encoder/4/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_5 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul_1 [Mul] inputs: [/encoder/4/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Mul_1 for ONNX node: /encoder/4/encoder/1/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul_1 [Mul] outputs: [/encoder/4/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Slice_1 [Slice] inputs: [/encoder/4/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Slice_1 for ONNX node: /encoder/4/encoder/1/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Slice_1 [Slice] outputs: [/encoder/4/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul_2 [Mul] inputs: [/encoder/4/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Mul_2 for ONNX node: /encoder/4/encoder/1/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Mul_2 [Mul] outputs: [/encoder/4/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Transpose [Transpose] inputs: [/encoder/4/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Transpose for ONNX node: /encoder/4/encoder/1/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Transpose [Transpose] outputs: [/encoder/4/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Shape_1 for ONNX node: /encoder/4/encoder/1/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Expand for ONNX node: /encoder/4/encoder/1/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Expand [Expand] outputs: [/encoder/4/encoder/1/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Cast [Cast] inputs: [/encoder/4/encoder/1/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Cast for ONNX node: /encoder/4/encoder/1/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Cast [Cast] outputs: [/encoder/4/encoder/1/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Constant_6 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Where [Where] inputs: [/encoder/4/encoder/1/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/1/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Where for ONNX node: /encoder/4/encoder/1/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Where [Where] outputs: [/encoder/4/encoder/1/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/1/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.1.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/Transpose_1 for ONNX node: /encoder/4/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Sub for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Exp for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Add [Add] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Add for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Log [Log] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Log for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Log [Log] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Cast for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Equal for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Where [Where] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Where for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Where [Where] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Mul for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9658 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9658 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9658 for ONNX node: onnx::MatMul_9658 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_3 [Add] inputs: [/encoder/4/encoder/1/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_3 for ONNX node: /encoder/4/encoder/1/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_3_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_3 [Add] outputs: [/encoder/4/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9659 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9659 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9659 for ONNX node: onnx::MatMul_9659 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/in_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Sub for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Exp for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Log for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Cast for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Equal for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Where for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Mul for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9660 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9660 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9660 for ONNX node: onnx::MatMul_9660 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_4 [Add] inputs: [/encoder/4/encoder/1/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_4 for ONNX node: /encoder/4/encoder/1/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_4_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_4 [Add] outputs: [/encoder/4/encoder/1/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Sub [Sub] inputs: [/encoder/4/encoder/1/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass_mid/Sub for ONNX node: /encoder/4/encoder/1/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Sub [Sub] outputs: [/encoder/4/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Mul [Mul] inputs: [/encoder/4/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass_mid/Mul for ONNX node: /encoder/4/encoder/1/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Mul [Mul] outputs: [/encoder/4/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Add [Add] inputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass_mid/Add for ONNX node: /encoder/4/encoder/1/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass_mid/Add [Add] outputs: [/encoder/4/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape [Shape] inputs: [/encoder/4/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Shape for ONNX node: /encoder/4/encoder/1/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape [Shape] outputs: [/encoder/4/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant [Constant] outputs: [/encoder/4/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather [Gather] inputs: [/encoder/4/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Constant_output_0 for ONNX node: /encoder/4/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Gather for ONNX node: /encoder/4/encoder/1/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather [Gather] outputs: [/encoder/4/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Shape_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather_1 [Gather] inputs: [/encoder/4/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Gather_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather_1 [Gather] outputs: [/encoder/4/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9661 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9661 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9661 for ONNX node: onnx::MatMul_9661 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/in_proj/Add for ONNX node: /encoder/4/encoder/1/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6206 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6206 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6206 [Constant] outputs: [onnx::Unsqueeze_7402 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7402 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7402 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6208 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6208 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6208 [Constant] outputs: [onnx::Unsqueeze_7404 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7404 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7404 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6210 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6210 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6210 [Constant] outputs: [onnx::Unsqueeze_7406 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7406 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7406 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Concat [Concat] inputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Concat for ONNX node: /encoder/4/encoder/1/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Concat [Concat] outputs: [/encoder/4/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Reshape [Reshape] inputs: [/encoder/4/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Reshape for ONNX node: /encoder/4/encoder/1/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Reshape [Reshape] outputs: [/encoder/4/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Transpose [Transpose] inputs: [/encoder/4/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Transpose for ONNX node: /encoder/4/encoder/1/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Transpose [Transpose] outputs: [/encoder/4/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape_2 [Shape] inputs: [/encoder/4/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Shape_2 for ONNX node: /encoder/4/encoder/1/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Shape_2 [Shape] outputs: [/encoder/4/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather_2 [Gather] inputs: [/encoder/4/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Gather_2 for ONNX node: /encoder/4/encoder/1/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Gather_2 [Gather] outputs: [/encoder/4/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/MatMul [MatMul] inputs: [/encoder/4/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/MatMul for ONNX node: /encoder/4/encoder/1/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Transpose_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Mul [Mul] inputs: [/encoder/4/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Mul for ONNX node: /encoder/4/encoder/1/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Mul [Mul] outputs: [/encoder/4/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6222 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6222 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6222 [Constant] outputs: [onnx::Unsqueeze_7419 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7419 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7419 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6224 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6224 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6224 [Constant] outputs: [onnx::Unsqueeze_7421 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7421 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7421 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6226 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6226 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6226 [Constant] outputs: [onnx::Unsqueeze_7423 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7423 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_7423 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/4/encoder/1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Concat_1 [Concat] inputs: [/encoder/4/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Concat_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Concat_1 [Concat] outputs: [/encoder/4/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/Reshape_1 for ONNX node: /encoder/4/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9663 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9663 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9663 for ONNX node: onnx::MatMul_9663 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/self_attn2/out_proj/Add for ONNX node: /encoder/4/encoder/1/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/self_attn2/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_5 [Add] inputs: [/encoder/4/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_5 for ONNX node: /encoder/4/encoder/1/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_5_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_5 [Add] outputs: [/encoder/4/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9664 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9664 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9664 for ONNX node: onnx::MatMul_9664 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/in_proj/Add for ONNX node: /encoder/4/encoder/1/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Shape [Shape] inputs: [/encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Shape for ONNX node: /encoder/4/encoder/1/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Shape [Shape] outputs: [/encoder/4/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Gather [Gather] inputs: [/encoder/4/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Gather for ONNX node: /encoder/4/encoder/1/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Gather [Gather] outputs: [/encoder/4/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Add [Add] inputs: [/encoder/4/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Add for ONNX node: /encoder/4/encoder/1/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Add [Add] outputs: [/encoder/4/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Div [Div] inputs: [/encoder/4/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Div for ONNX node: /encoder/4/encoder/1/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Div_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Div [Div] outputs: [/encoder/4/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul [Mul] inputs: [/encoder/4/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Mul for ONNX node: /encoder/4/encoder/1/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul [Mul] outputs: [/encoder/4/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Slice [Slice] inputs: [/encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Slice for ONNX node: /encoder/4/encoder/1/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Slice [Slice] outputs: [/encoder/4/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_5 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul_1 [Mul] inputs: [/encoder/4/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Mul_1 for ONNX node: /encoder/4/encoder/1/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul_1 [Mul] outputs: [/encoder/4/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Slice_1 [Slice] inputs: [/encoder/4/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Slice_1 for ONNX node: /encoder/4/encoder/1/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Slice_1 [Slice] outputs: [/encoder/4/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul_2 [Mul] inputs: [/encoder/4/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Mul_2 for ONNX node: /encoder/4/encoder/1/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Mul_2 [Mul] outputs: [/encoder/4/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Transpose [Transpose] inputs: [/encoder/4/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Transpose for ONNX node: /encoder/4/encoder/1/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Transpose [Transpose] outputs: [/encoder/4/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Shape_1 [Shape] inputs: [/encoder/4/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Shape_1 for ONNX node: /encoder/4/encoder/1/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Shape_1 [Shape] outputs: [/encoder/4/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Expand for ONNX node: /encoder/4/encoder/1/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Expand [Expand] outputs: [/encoder/4/encoder/1/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Cast [Cast] inputs: [/encoder/4/encoder/1/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Cast for ONNX node: /encoder/4/encoder/1/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Cast [Cast] outputs: [/encoder/4/encoder/1/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Constant_6 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Where [Where] inputs: [/encoder/4/encoder/1/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/1/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Where for ONNX node: /encoder/4/encoder/1/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Where [Where] outputs: [/encoder/4/encoder/1/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/1/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.1.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/Transpose_1 for ONNX node: /encoder/4/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Sub for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Exp for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Add [Add] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Add for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Log [Log] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Log for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Log [Log] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Cast for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Equal for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Where [Where] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Where for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Where [Where] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Mul for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9665 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9665 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9665 for ONNX node: onnx::MatMul_9665 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_6 [Add] inputs: [/encoder/4/encoder/1/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_6 for ONNX node: /encoder/4/encoder/1/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_6_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_6 [Add] outputs: [/encoder/4/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9666 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9666 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9666 for ONNX node: onnx::MatMul_9666 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/in_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Sub for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Exp for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Add for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Log for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Cast for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Equal for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Where for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Mul for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9667 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9667 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9667 for ONNX node: onnx::MatMul_9667 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_7 [Add] inputs: [/encoder/4/encoder/1/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/Add_7 for ONNX node: /encoder/4/encoder/1/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/Add_7_output_0 for ONNX tensor: /encoder/4/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/Add_7 [Add] outputs: [/encoder/4/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Sub [Sub] inputs: [/encoder/4/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.1.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.norm.bias for ONNX node: encoder.encoders.4.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Sub for ONNX node: /encoder/4/encoder/1/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Sub [Sub] outputs: [/encoder/4/encoder/1/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Constant [Constant] outputs: [/encoder/4/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Pow [Pow] inputs: [/encoder/4/encoder/1/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Constant_output_0 for ONNX node: /encoder/4/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Pow for ONNX node: /encoder/4/encoder/1/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Pow_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Pow [Pow] outputs: [/encoder/4/encoder/1/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/ReduceMean [ReduceMean] inputs: [/encoder/4/encoder/1/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/ReduceMean for ONNX node: /encoder/4/encoder/1/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/ReduceMean [ReduceMean] outputs: [/encoder/4/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Constant_1 [Constant] outputs: [/encoder/4/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Pow_1 [Pow] inputs: [/encoder/4/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Constant_1_output_0 for ONNX node: /encoder/4/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Pow_1 for ONNX node: /encoder/4/encoder/1/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Pow_1_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Pow_1 [Pow] outputs: [/encoder/4/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Exp [Exp] inputs: [encoder.encoders.4.encoder.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.norm.log_scale for ONNX node: encoder.encoders.4.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Exp for ONNX node: /encoder/4/encoder/1/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Exp_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Exp [Exp] outputs: [/encoder/4/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Mul [Mul] inputs: [/encoder/4/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Mul for ONNX node: /encoder/4/encoder/1/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Mul [Mul] outputs: [/encoder/4/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Mul_1 [Mul] inputs: [/encoder/4/encoder/1/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/norm/Mul_1 for ONNX node: /encoder/4/encoder/1/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/norm/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/norm/Mul_1 [Mul] outputs: [/encoder/4/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Sub [Sub] inputs: [/encoder/4/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass/Sub for ONNX node: /encoder/4/encoder/1/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass/Sub_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Sub [Sub] outputs: [/encoder/4/encoder/1/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Mul [Mul] inputs: [/encoder/4/encoder/1/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.1.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass/Mul for ONNX node: /encoder/4/encoder/1/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass/Mul_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Mul [Mul] outputs: [/encoder/4/encoder/1/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/1/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Add [Add] inputs: [/encoder/4/encoder/0/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/1/bypass/Add for ONNX node: /encoder/4/encoder/1/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/1/bypass/Add_output_0 for ONNX tensor: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/1/bypass/Add [Add] outputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9668 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9668 -> (384, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9668 for ONNX node: onnx::MatMul_9668 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/in_proj/Add for ONNX node: /encoder/4/encoder/2/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice [Slice] inputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Slice for ONNX node: /encoder/4/encoder/2/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice [Slice] outputs: [/encoder/4/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Slice_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/4/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/4/encoder/2/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Slice_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/4/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6332 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6332 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6332 [Constant] outputs: [onnx::Unsqueeze_7535 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7535 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7535 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6334 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6334 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6334 [Constant] outputs: [onnx::Unsqueeze_7537 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7537 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7537 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6339 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6339 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6339 [Constant] outputs: [onnx::Unsqueeze_7544 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7544 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7544 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6341 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6341 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6341 [Constant] outputs: [onnx::Unsqueeze_7546 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7546 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7546 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6347 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6347 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6347 [Constant] outputs: [onnx::Unsqueeze_7554 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7554 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7554 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6349 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6349 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6349 [Constant] outputs: [onnx::Unsqueeze_7556 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7556 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7556 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose [Transpose] inputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Transpose for ONNX node: /encoder/4/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose [Transpose] outputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Transpose_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Transpose_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/MatMul [MatMul] inputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/MatMul for ONNX node: /encoder/4/encoder/2/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9675 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/4/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9675 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9675 for ONNX node: onnx::MatMul_9675 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Mul [Mul] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Mul for ONNX node: /encoder/4/encoder/2/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Mul [Mul] outputs: [/encoder/4/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Sub [Sub] inputs: [/encoder/4/encoder/2/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Sub for ONNX node: /encoder/4/encoder/2/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Sub [Sub] outputs: [/encoder/4/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6366 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6366 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6366 [Constant] outputs: [onnx::Unsqueeze_7577 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7577 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_7577 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Transpose_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/4/encoder/2/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/MatMul_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather_3 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_4 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather_4 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_5 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Gather_5 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/4/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Sub_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast [Cast] inputs: [/encoder/4/encoder/2/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Cast for ONNX node: /encoder/4/encoder/2/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast [Cast] outputs: [/encoder/4/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Range [Range] inputs: [/encoder/4/encoder/2/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Range for ONNX node: /encoder/4/encoder/2/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Range [Range] outputs: [/encoder/4/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Cast_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/4/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Range_1 [Range] inputs: [/encoder/4/encoder/2/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Range_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Range_1 [Range] outputs: [/encoder/4/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Mul_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6397 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6397 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6397 [Constant] outputs: [onnx::Unsqueeze_7610 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7610 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7610 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_4 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6400 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6400 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6400 [Constant] outputs: [onnx::Unsqueeze_7613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7613 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_5 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Shape_6 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/4/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/4/encoder/2/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/4/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Expand [Expand] inputs: [/encoder/4/encoder/2/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Expand for ONNX node: /encoder/4/encoder/2/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Expand [Expand] outputs: [/encoder/4/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Tile [Tile] inputs: [/encoder/4/encoder/2/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Tile for ONNX node: /encoder/4/encoder/2/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Tile [Tile] outputs: [/encoder/4/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Add [Add] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Add for ONNX node: /encoder/4/encoder/2/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Add [Add] outputs: [/encoder/4/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6411 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6411 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6411 [Constant] outputs: [onnx::Unsqueeze_7625 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7625 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_7625 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_6 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape_4 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/GatherElements for ONNX node: /encoder/4/encoder/2/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/4/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6416 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6416 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6416 [Constant] outputs: [onnx::Unsqueeze_7630 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7630 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7630 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6418 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6418 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6418 [Constant] outputs: [onnx::Unsqueeze_7632 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7632 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7632 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6420 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6420 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6420 [Constant] outputs: [onnx::Unsqueeze_7634 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7634 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7634 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6422 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6422 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6422 [Constant] outputs: [onnx::Unsqueeze_7636 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7636 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7636 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Concat_7 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/4/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/4/encoder/2/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Reshape_5 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/4/encoder/2/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Add_1 [Add] inputs: [/encoder/4/encoder/2/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Add_1 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Add_1 [Add] outputs: [/encoder/4/encoder/2/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Cast_2 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/4/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Where [Where] inputs: [/encoder/4/encoder/2/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/4/encoder/2/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Where for ONNX node: /encoder/4/encoder/2/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Where [Where] outputs: [/encoder/4/encoder/2/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Softmax [Softmax] inputs: [/encoder/4/encoder/2/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn_weights/Softmax for ONNX node: /encoder/4/encoder/2/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn_weights/Softmax [Softmax] outputs: [/encoder/4/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9682 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9682 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9682 for ONNX node: onnx::MatMul_9682 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/in_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Sub for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Exp for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Add [Add] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Log [Log] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Log for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Log [Log] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Cast for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Equal for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Where [Where] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Where for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Where [Where] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/2/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Mul for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9683 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9683 -> (768, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9683 for ONNX node: onnx::MatMul_9683 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add [Add] inputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add for ONNX node: /encoder/4/encoder/2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add [Add] outputs: [/encoder/4/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant [Constant] outputs: [/encoder/4/encoder/2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Slice [Slice] inputs: [/encoder/4/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/Constant_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Slice for ONNX node: /encoder/4/encoder/2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Slice_output_0 for ONNX tensor: /encoder/4/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Slice [Slice] outputs: [/encoder/4/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9684 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9684 -> (384, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9684 for ONNX node: onnx::MatMul_9684 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias -> (864)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/in_proj/Add for ONNX node: /encoder/4/encoder/2/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape [Shape] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Add [Add] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Add for ONNX node: /encoder/4/encoder/2/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Add [Add] outputs: [/encoder/4/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Div [Div] inputs: [/encoder/4/encoder/2/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Div for ONNX node: /encoder/4/encoder/2/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Div [Div] outputs: [/encoder/4/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul [Mul] inputs: [/encoder/4/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Mul for ONNX node: /encoder/4/encoder/2/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul [Mul] outputs: [/encoder/4/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice [Slice] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Slice for ONNX node: /encoder/4/encoder/2/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice [Slice] outputs: [/encoder/4/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/4/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Mul_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Slice_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/4/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/4/encoder/2/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Mul_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/4/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/4/encoder/2/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 864)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Slice_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/4/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/4/encoder/2/nonlin_attention/Slice_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh for ONNX node: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/4/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 288), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6484 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6484 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6484 [Constant] outputs: [onnx::Unsqueeze_7701 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7701 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7701 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6486 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6486 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6486 [Constant] outputs: [onnx::Unsqueeze_7703 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7703 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7703 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat [Concat] inputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Concat for ONNX node: /encoder/4/encoder/2/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat [Concat] outputs: [/encoder/4/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape [Reshape] inputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 288, 1)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Reshape for ONNX node: /encoder/4/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape [Reshape] outputs: [/encoder/4/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/4/encoder/2/nonlin_attention/Slice_1_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Reshape_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Mul_3 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape_3 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather_3 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape_4 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather_4 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/4/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Shape_5 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/4/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/4/encoder/2/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Gather_5 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/4/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6501 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6501 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6501 [Constant] outputs: [onnx::Unsqueeze_7719 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7719 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7719 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6503 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6503 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6503 [Constant] outputs: [onnx::Unsqueeze_7721 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7721 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7721 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6505 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6505 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6505 [Constant] outputs: [onnx::Unsqueeze_7723 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7723 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_7723 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Concat_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/4/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/2/nonlin_attention/Mul_3_output_0 -> (-1, -1, 288)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Reshape_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Transpose [Transpose] inputs: [/encoder/4/encoder/2/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Transpose for ONNX node: /encoder/4/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Transpose [Transpose] outputs: [/encoder/4/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/MatMul for ONNX node: /encoder/4/encoder/2/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/MatMul [MatMul] outputs: [/encoder/4/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Transpose_1 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6513 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6513 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6513 [Constant] outputs: [onnx::Unsqueeze_7732 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7732 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_7732 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6515 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6515 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6515 [Constant] outputs: [onnx::Unsqueeze_7734 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7734 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/4/encoder/2/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_7734 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/4/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Concat_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/4/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/4/encoder/2/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 288)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Reshape_2 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/4/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/4/encoder/2/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/Slice_2_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/Mul_4 for ONNX node: /encoder/4/encoder/2/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/4/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9688 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/nonlin_attention/Mul_4_output_0 -> (-1, -1, 288)[FLOAT]], [onnx::MatMul_9688 -> (288, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9688 for ONNX node: onnx::MatMul_9688 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/nonlin_attention/out_proj/Add for ONNX node: /encoder/4/encoder/2/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_1 [Add] inputs: [/encoder/4/encoder/2/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_1 for ONNX node: /encoder/4/encoder/2/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_1 [Add] outputs: [/encoder/4/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape [Shape] inputs: [/encoder/4/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Shape for ONNX node: /encoder/4/encoder/2/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape [Shape] outputs: [/encoder/4/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant [Constant] outputs: [/encoder/4/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather [Gather] inputs: [/encoder/4/encoder/2/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Constant_output_0 for ONNX node: /encoder/4/encoder/2/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Gather for ONNX node: /encoder/4/encoder/2/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather [Gather] outputs: [/encoder/4/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Shape_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_1 [Gather] inputs: [/encoder/4/encoder/2/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Gather_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_1 [Gather] outputs: [/encoder/4/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_2 [Shape] inputs: [/encoder/4/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Shape_2 for ONNX node: /encoder/4/encoder/2/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_2 [Shape] outputs: [/encoder/4/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_2 [Gather] inputs: [/encoder/4/encoder/2/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Gather_2 for ONNX node: /encoder/4/encoder/2/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_2 [Gather] outputs: [/encoder/4/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9689 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9689 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9689 for ONNX node: onnx::MatMul_9689 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/2/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/in_proj/Add for ONNX node: /encoder/4/encoder/2/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6535 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6535 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6535 [Constant] outputs: [onnx::Unsqueeze_7757 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7757 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7757 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6537 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6537 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6537 [Constant] outputs: [onnx::Unsqueeze_7759 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7759 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7759 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6539 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6539 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6539 [Constant] outputs: [onnx::Unsqueeze_7761 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7761 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7761 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze_2 for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Concat [Concat] inputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Concat for ONNX node: /encoder/4/encoder/2/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Concat_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Concat [Concat] outputs: [/encoder/4/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Reshape [Reshape] inputs: [/encoder/4/encoder/2/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/2/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Reshape for ONNX node: /encoder/4/encoder/2/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Reshape [Reshape] outputs: [/encoder/4/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Transpose [Transpose] inputs: [/encoder/4/encoder/2/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Transpose for ONNX node: /encoder/4/encoder/2/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Transpose [Transpose] outputs: [/encoder/4/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_3 [Shape] inputs: [/encoder/4/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Shape_3 for ONNX node: /encoder/4/encoder/2/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Shape_3 [Shape] outputs: [/encoder/4/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_3 [Gather] inputs: [/encoder/4/encoder/2/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Gather_3 for ONNX node: /encoder/4/encoder/2/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Gather_3 [Gather] outputs: [/encoder/4/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/MatMul [MatMul] inputs: [/encoder/4/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/MatMul for ONNX node: /encoder/4/encoder/2/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Transpose_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Mul [Mul] inputs: [/encoder/4/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Mul for ONNX node: /encoder/4/encoder/2/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Mul [Mul] outputs: [/encoder/4/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6551 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6551 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6551 [Constant] outputs: [onnx::Unsqueeze_7774 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7774 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7774 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze_3 for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6553 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6553 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6553 [Constant] outputs: [onnx::Unsqueeze_7776 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7776 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7776 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze_4 for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6555 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6555 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6555 [Constant] outputs: [onnx::Unsqueeze_7778 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7778 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_7778 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Unsqueeze_5 for ONNX node: /encoder/4/encoder/2/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Concat_1 [Concat] inputs: [/encoder/4/encoder/2/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Concat_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Concat_1 [Concat] outputs: [/encoder/4/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/2/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/2/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/Reshape_1 for ONNX node: /encoder/4/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9691 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9691 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9691 for ONNX node: onnx::MatMul_9691 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn1/out_proj/Add for ONNX node: /encoder/4/encoder/2/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn1/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_2 [Add] inputs: [/encoder/4/encoder/2/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/self_attn1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_2 for ONNX node: /encoder/4/encoder/2/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_2_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_2 [Add] outputs: [/encoder/4/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9692 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9692 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9692 for ONNX node: onnx::MatMul_9692 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/2/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/in_proj/Add for ONNX node: /encoder/4/encoder/2/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Shape [Shape] inputs: [/encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Shape for ONNX node: /encoder/4/encoder/2/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Shape [Shape] outputs: [/encoder/4/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Gather [Gather] inputs: [/encoder/4/encoder/2/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Gather for ONNX node: /encoder/4/encoder/2/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Gather [Gather] outputs: [/encoder/4/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Add [Add] inputs: [/encoder/4/encoder/2/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Add for ONNX node: /encoder/4/encoder/2/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Add [Add] outputs: [/encoder/4/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Div [Div] inputs: [/encoder/4/encoder/2/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Div for ONNX node: /encoder/4/encoder/2/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Div_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Div [Div] outputs: [/encoder/4/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul [Mul] inputs: [/encoder/4/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Mul for ONNX node: /encoder/4/encoder/2/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul [Mul] outputs: [/encoder/4/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Slice [Slice] inputs: [/encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Slice for ONNX node: /encoder/4/encoder/2/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Slice_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Slice [Slice] outputs: [/encoder/4/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_5 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul_1 [Mul] inputs: [/encoder/4/encoder/2/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_5_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Mul_1 for ONNX node: /encoder/4/encoder/2/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul_1 [Mul] outputs: [/encoder/4/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Slice_1 [Slice] inputs: [/encoder/4/encoder/2/conv_module1/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Slice_1 for ONNX node: /encoder/4/encoder/2/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Slice_1 [Slice] outputs: [/encoder/4/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/2/conv_module1/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul_2 [Mul] inputs: [/encoder/4/encoder/2/conv_module1/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Mul_2 for ONNX node: /encoder/4/encoder/2/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Mul_2 [Mul] outputs: [/encoder/4/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Transpose [Transpose] inputs: [/encoder/4/encoder/2/conv_module1/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Transpose for ONNX node: /encoder/4/encoder/2/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Transpose [Transpose] outputs: [/encoder/4/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Shape_1 for ONNX node: /encoder/4/encoder/2/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/2/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Expand for ONNX node: /encoder/4/encoder/2/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Expand_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Expand [Expand] outputs: [/encoder/4/encoder/2/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Cast [Cast] inputs: [/encoder/4/encoder/2/conv_module1/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Cast for ONNX node: /encoder/4/encoder/2/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Cast [Cast] outputs: [/encoder/4/encoder/2/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Constant_6 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Where [Where] inputs: [/encoder/4/encoder/2/conv_module1/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/2/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/2/conv_module1/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Constant_6_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Where for ONNX node: /encoder/4/encoder/2/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Where [Where] outputs: [/encoder/4/encoder/2/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/2/conv_module1/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.2.conv_module1.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/Transpose_1 for ONNX node: /encoder/4/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Sub for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Exp for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Add [Add] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Add for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Log [Log] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Log for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Log [Log] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Cast for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Equal for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Where [Where] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/2/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Where for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Where [Where] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/2/conv_module1/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Mul for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9693 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9693 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9693 for ONNX node: onnx::MatMul_9693 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module1/out_proj/Add_1 for ONNX node: /encoder/4/encoder/2/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_3 [Add] inputs: [/encoder/4/encoder/2/Add_2_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_3 for ONNX node: /encoder/4/encoder/2/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_3_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_3 [Add] outputs: [/encoder/4/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9694 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9694 -> (384, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9694 for ONNX node: onnx::MatMul_9694 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias -> (1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/in_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Sub for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Exp for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Add [Add] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Log [Log] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Log for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Log [Log] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Cast for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Equal for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Where [Where] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 1024)[BOOL]], [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Where for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Where [Where] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/2/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Mul for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 1024)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9695 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 1024)[FLOAT]], [onnx::MatMul_9695 -> (1024, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9695 for ONNX node: onnx::MatMul_9695 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_4 [Add] inputs: [/encoder/4/encoder/2/Add_3_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_4 for ONNX node: /encoder/4/encoder/2/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_4_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_4 [Add] outputs: [/encoder/4/encoder/2/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Sub [Sub] inputs: [/encoder/4/encoder/2/Add_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass_mid/Sub for ONNX node: /encoder/4/encoder/2/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Sub [Sub] outputs: [/encoder/4/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Mul [Mul] inputs: [/encoder/4/encoder/2/bypass_mid/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass_mid/Mul for ONNX node: /encoder/4/encoder/2/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Mul [Mul] outputs: [/encoder/4/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Add [Add] inputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/bypass_mid/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass_mid/Add for ONNX node: /encoder/4/encoder/2/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass_mid/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass_mid/Add [Add] outputs: [/encoder/4/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape [Shape] inputs: [/encoder/4/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Shape for ONNX node: /encoder/4/encoder/2/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape [Shape] outputs: [/encoder/4/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant [Constant] outputs: [/encoder/4/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather [Gather] inputs: [/encoder/4/encoder/2/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Constant_output_0 for ONNX node: /encoder/4/encoder/2/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Gather for ONNX node: /encoder/4/encoder/2/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather [Gather] outputs: [/encoder/4/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Shape_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather_1 [Gather] inputs: [/encoder/4/encoder/2/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Gather_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather_1 [Gather] outputs: [/encoder/4/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9696 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9696 -> (384, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9696 for ONNX node: onnx::MatMul_9696 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/4/encoder/2/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/in_proj/Add for ONNX node: /encoder/4/encoder/2/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6637 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6637 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6637 [Constant] outputs: [onnx::Unsqueeze_7866 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7866 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7866 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6639 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6639 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6639 [Constant] outputs: [onnx::Unsqueeze_7868 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7868 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7868 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6641 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6641 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6641 [Constant] outputs: [onnx::Unsqueeze_7870 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7870 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_7870 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze_2 for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Concat [Concat] inputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Concat for ONNX node: /encoder/4/encoder/2/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Concat_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Concat [Concat] outputs: [/encoder/4/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Reshape [Reshape] inputs: [/encoder/4/encoder/2/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/4/encoder/2/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Reshape for ONNX node: /encoder/4/encoder/2/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Reshape [Reshape] outputs: [/encoder/4/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Transpose [Transpose] inputs: [/encoder/4/encoder/2/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Transpose for ONNX node: /encoder/4/encoder/2/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Transpose [Transpose] outputs: [/encoder/4/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape_2 [Shape] inputs: [/encoder/4/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Shape_2 for ONNX node: /encoder/4/encoder/2/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Shape_2 [Shape] outputs: [/encoder/4/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather_2 [Gather] inputs: [/encoder/4/encoder/2/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/4/encoder/2/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Gather_2 for ONNX node: /encoder/4/encoder/2/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Gather_2 [Gather] outputs: [/encoder/4/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/MatMul [MatMul] inputs: [/encoder/4/encoder/2/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/4/encoder/2/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/MatMul for ONNX node: /encoder/4/encoder/2/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Transpose_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Mul [Mul] inputs: [/encoder/4/encoder/2/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/4/encoder/2/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Mul for ONNX node: /encoder/4/encoder/2/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Mul [Mul] outputs: [/encoder/4/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6653 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6653 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6653 [Constant] outputs: [onnx::Unsqueeze_7883 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7883 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_7883 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze_3 for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6655 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6655 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6655 [Constant] outputs: [onnx::Unsqueeze_7885 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7885 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_7885 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze_4 for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6657 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6657 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6657 [Constant] outputs: [onnx::Unsqueeze_7887 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_7887 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/encoder/2/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_7887 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Unsqueeze_5 for ONNX node: /encoder/4/encoder/2/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Concat_1 [Concat] inputs: [/encoder/4/encoder/2/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Concat_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Concat_1 [Concat] outputs: [/encoder/4/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/4/encoder/2/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/4/encoder/2/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/Reshape_1 for ONNX node: /encoder/4/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/4/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9698 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9698 -> (48, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9698 for ONNX node: onnx::MatMul_9698 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/self_attn2/out_proj/Add for ONNX node: /encoder/4/encoder/2/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/self_attn2/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_5 [Add] inputs: [/encoder/4/encoder/2/bypass_mid/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/self_attn2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_5 for ONNX node: /encoder/4/encoder/2/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_5_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_5 [Add] outputs: [/encoder/4/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9699 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9699 -> (384, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9699 for ONNX node: onnx::MatMul_9699 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias -> (768)[FLOAT]], [/encoder/4/encoder/2/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/in_proj/Add for ONNX node: /encoder/4/encoder/2/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Shape [Shape] inputs: [/encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Shape for ONNX node: /encoder/4/encoder/2/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Shape_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Shape [Shape] outputs: [/encoder/4/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Gather [Gather] inputs: [/encoder/4/encoder/2/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Gather for ONNX node: /encoder/4/encoder/2/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Gather_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Gather [Gather] outputs: [/encoder/4/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Add [Add] inputs: [/encoder/4/encoder/2/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Add for ONNX node: /encoder/4/encoder/2/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Add [Add] outputs: [/encoder/4/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Div [Div] inputs: [/encoder/4/encoder/2/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Div for ONNX node: /encoder/4/encoder/2/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Div_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Div [Div] outputs: [/encoder/4/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul [Mul] inputs: [/encoder/4/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Mul for ONNX node: /encoder/4/encoder/2/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul [Mul] outputs: [/encoder/4/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Slice [Slice] inputs: [/encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Slice for ONNX node: /encoder/4/encoder/2/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Slice_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Slice [Slice] outputs: [/encoder/4/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_5 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul_1 [Mul] inputs: [/encoder/4/encoder/2/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_5_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Mul_1 for ONNX node: /encoder/4/encoder/2/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul_1 [Mul] outputs: [/encoder/4/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Slice_1 [Slice] inputs: [/encoder/4/encoder/2/conv_module2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/4/encoder/2/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/4/encoder/2/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Slice_1 for ONNX node: /encoder/4/encoder/2/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Slice_1 [Slice] outputs: [/encoder/4/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/4/encoder/2/conv_module2/Slice_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul_2 [Mul] inputs: [/encoder/4/encoder/2/conv_module2/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Mul_2 for ONNX node: /encoder/4/encoder/2/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Mul_2 [Mul] outputs: [/encoder/4/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Transpose [Transpose] inputs: [/encoder/4/encoder/2/conv_module2/Mul_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Transpose for ONNX node: /encoder/4/encoder/2/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Transpose [Transpose] outputs: [/encoder/4/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Shape_1 for ONNX node: /encoder/4/encoder/2/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Shape_1 [Shape] outputs: [/encoder/4/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Expand [Expand] inputs: [/encoder/2/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/4/encoder/2/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Expand for ONNX node: /encoder/4/encoder/2/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Expand_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Expand [Expand] outputs: [/encoder/4/encoder/2/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Cast [Cast] inputs: [/encoder/4/encoder/2/conv_module2/Expand_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Cast for ONNX node: /encoder/4/encoder/2/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Cast [Cast] outputs: [/encoder/4/encoder/2/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Constant_6 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Where [Where] inputs: [/encoder/4/encoder/2/conv_module2/Cast_output_0 -> (-1, 384, -1)[BOOL]], [/encoder/4/encoder/2/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/4/encoder/2/conv_module2/Transpose_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Constant_6_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Where for ONNX node: /encoder/4/encoder/2/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Where [Where] outputs: [/encoder/4/encoder/2/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/4/encoder/2/conv_module2/Where_output_0 -> (-1, 384, -1)[FLOAT]], [encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.weight -> (384, 1, 15)[FLOAT]], [encoder.encoders.4.encoder.layers.2.conv_module2.depthwise_conv.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 384, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 384, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 384 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 384, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/4/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/4/encoder/2/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 384, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/Transpose_1 for ONNX node: /encoder/4/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/4/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Sub for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Exp for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Add [Add] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Add for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Log [Log] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Log for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Log [Log] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Log_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Cast for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Equal for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Where [Where] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 384)[BOOL]], [/encoder/4/encoder/2/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Where for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Where [Where] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/2/conv_module2/Transpose_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Mul for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Where_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9700 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9700 -> (384, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9700 for ONNX node: onnx::MatMul_9700 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/conv_module2/out_proj/Add_1 for ONNX node: /encoder/4/encoder/2/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_6 [Add] inputs: [/encoder/4/encoder/2/Add_5_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_6 for ONNX node: /encoder/4/encoder/2/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_6_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_6 [Add] outputs: [/encoder/4/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9701 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [onnx::MatMul_9701 -> (384, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9701 for ONNX node: onnx::MatMul_9701 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias -> (1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/in_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/in_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Sub for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Exp for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Add [Add] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Add for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Add [Add] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Log [Log] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Log for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Log [Log] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Cast for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Equal for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Where [Where] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 1280)[BOOL]], [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Where for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Where [Where] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/4/encoder/2/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Mul for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 1280)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9702 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 1280)[FLOAT]], [onnx::MatMul_9702 -> (1280, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9702 for ONNX node: onnx::MatMul_9702 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias -> (384)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/4/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_7 [Add] inputs: [/encoder/4/encoder/2/Add_6_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/Add_7 for ONNX node: /encoder/4/encoder/2/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/Add_7_output_0 for ONNX tensor: /encoder/4/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/Add_7 [Add] outputs: [/encoder/4/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Sub [Sub] inputs: [/encoder/4/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.2.norm.bias -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.norm.bias for ONNX node: encoder.encoders.4.encoder.layers.2.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Sub for ONNX node: /encoder/4/encoder/2/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Sub [Sub] outputs: [/encoder/4/encoder/2/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Constant [Constant] outputs: [/encoder/4/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Pow [Pow] inputs: [/encoder/4/encoder/2/norm/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Constant_output_0 for ONNX node: /encoder/4/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Pow for ONNX node: /encoder/4/encoder/2/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Pow_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Pow [Pow] outputs: [/encoder/4/encoder/2/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/ReduceMean [ReduceMean] inputs: [/encoder/4/encoder/2/norm/Pow_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/ReduceMean for ONNX node: /encoder/4/encoder/2/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/ReduceMean_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/ReduceMean [ReduceMean] outputs: [/encoder/4/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Constant_1 [Constant] outputs: [/encoder/4/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Pow_1 [Pow] inputs: [/encoder/4/encoder/2/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/2/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Constant_1_output_0 for ONNX node: /encoder/4/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Pow_1 for ONNX node: /encoder/4/encoder/2/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Pow_1_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Pow_1 [Pow] outputs: [/encoder/4/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Exp [Exp] inputs: [encoder.encoders.4.encoder.layers.2.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.norm.log_scale for ONNX node: encoder.encoders.4.encoder.layers.2.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Exp for ONNX node: /encoder/4/encoder/2/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Exp_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Exp [Exp] outputs: [/encoder/4/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Mul [Mul] inputs: [/encoder/4/encoder/2/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/4/encoder/2/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Mul for ONNX node: /encoder/4/encoder/2/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Mul [Mul] outputs: [/encoder/4/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Mul_1 [Mul] inputs: [/encoder/4/encoder/2/Add_7_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/norm/Mul_1 for ONNX node: /encoder/4/encoder/2/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/norm/Mul_1_output_0 for ONNX tensor: /encoder/4/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/norm/Mul_1 [Mul] outputs: [/encoder/4/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Sub [Sub] inputs: [/encoder/4/encoder/2/norm/Mul_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass/Sub for ONNX node: /encoder/4/encoder/2/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass/Sub_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Sub [Sub] outputs: [/encoder/4/encoder/2/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Mul [Mul] inputs: [/encoder/4/encoder/2/bypass/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.encoder.layers.2.bypass.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.encoder.layers.2.bypass.bypass_scale for ONNX node: encoder.encoders.4.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass/Mul for ONNX node: /encoder/4/encoder/2/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass/Mul_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Mul [Mul] outputs: [/encoder/4/encoder/2/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/encoder/2/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Add [Add] inputs: [/encoder/4/encoder/1/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/encoder/2/bypass/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/encoder/2/bypass/Add for ONNX node: /encoder/4/encoder/2/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/encoder/2/bypass/Add_output_0 for ONNX tensor: /encoder/4/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/encoder/2/bypass/Add [Add] outputs: [/encoder/4/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape [Shape] inputs: [/encoder/4/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Shape for ONNX node: /encoder/4/upsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Shape_output_0 for ONNX tensor: /encoder/4/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape [Shape] outputs: [/encoder/4/upsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant [Constant] outputs: [/encoder/4/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather [Gather] inputs: [/encoder/4/upsample/Shape_output_0 -> (3)[INT32]], [/encoder/4/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_output_0 for ONNX node: /encoder/4/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Gather for ONNX node: /encoder/4/upsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Gather_output_0 for ONNX tensor: /encoder/4/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather [Gather] outputs: [/encoder/4/upsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_1 [Shape] inputs: [/encoder/4/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Shape_1 for ONNX node: /encoder/4/upsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Shape_1_output_0 for ONNX tensor: /encoder/4/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_1 [Shape] outputs: [/encoder/4/upsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_1 [Constant] outputs: [/encoder/4/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather_1 [Gather] inputs: [/encoder/4/upsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/4/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_1_output_0 for ONNX node: /encoder/4/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Gather_1 for ONNX node: /encoder/4/upsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Gather_1_output_0 for ONNX tensor: /encoder/4/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather_1 [Gather] outputs: [/encoder/4/upsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_2 [Shape] inputs: [/encoder/4/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Shape_2 for ONNX node: /encoder/4/upsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Shape_2_output_0 for ONNX tensor: /encoder/4/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_2 [Shape] outputs: [/encoder/4/upsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_2 [Constant] outputs: [/encoder/4/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather_2 [Gather] inputs: [/encoder/4/upsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/4/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_2_output_0 for ONNX node: /encoder/4/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Gather_2 for ONNX node: /encoder/4/upsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Gather_2_output_0 for ONNX tensor: /encoder/4/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Gather_2 [Gather] outputs: [/encoder/4/upsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_3 [Constant] outputs: [/encoder/4/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/encoder/2/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze [Unsqueeze] inputs: [/encoder/4/encoder/2/bypass/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 384), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze for ONNX node: /encoder/4/upsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_4 [Constant] outputs: [/encoder/4/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/4/upsample/Gather_output_0 -> ()[INT32]], [/encoder/4/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_1 for ONNX node: /encoder/4/upsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_5 [Constant] outputs: [/encoder/4/upsample/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_6 [Constant] outputs: [/encoder/4/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/4/upsample/Gather_1_output_0 -> ()[INT32]], [/encoder/4/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_2 for ONNX node: /encoder/4/upsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_7 [Constant] outputs: [/encoder/4/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/4/upsample/Gather_2_output_0 -> ()[INT32]], [/encoder/4/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_3 for ONNX node: /encoder/4/upsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Concat [Concat] inputs: [/encoder/4/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/4/upsample/Constant_5_output_0 -> (1)[INT32]], [/encoder/4/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/4/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_5_output_0 for ONNX node: /encoder/4/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Concat for ONNX node: /encoder/4/upsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Concat_output_0 for ONNX tensor: /encoder/4/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Concat [Concat] outputs: [/encoder/4/upsample/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_8 [Constant] outputs: [/encoder/4/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Reshape [Reshape] inputs: [/encoder/4/upsample/Concat_output_0 -> (4)[INT32]], [/encoder/4/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Reshape for ONNX node: /encoder/4/upsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Reshape_output_0 for ONNX tensor: /encoder/4/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Reshape [Reshape] outputs: [/encoder/4/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_3 [Shape] inputs: [/encoder/4/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Shape_3 for ONNX node: /encoder/4/upsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Shape_3_output_0 for ONNX tensor: /encoder/4/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Shape_3 [Shape] outputs: [/encoder/4/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/4/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/4/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/4/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_9 [Constant] outputs: [/encoder/4/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Mul [Mul] inputs: [/encoder/4/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/4/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_9_output_0 for ONNX node: /encoder/4/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Mul for ONNX node: /encoder/4/upsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Mul_output_0 for ONNX tensor: /encoder/4/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Mul [Mul] outputs: [/encoder/4/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Equal [Equal] inputs: [/encoder/4/upsample/Reshape_output_0 -> (4)[INT32]], [/encoder/4/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Equal for ONNX node: /encoder/4/upsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Equal_output_0 for ONNX tensor: /encoder/4/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Equal [Equal] outputs: [/encoder/4/upsample/Equal_output_0 -> (4)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Where [Where] inputs: [/encoder/4/upsample/Equal_output_0 -> (4)[BOOL]], [/encoder/4/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/4/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Where for ONNX node: /encoder/4/upsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Where_output_0 for ONNX tensor: /encoder/4/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Where [Where] outputs: [/encoder/4/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Expand [Expand] inputs: [/encoder/4/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 384)[FLOAT]], [/encoder/4/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Expand for ONNX node: /encoder/4/upsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Expand_output_0 for ONNX tensor: /encoder/4/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Expand [Expand] outputs: [/encoder/4/upsample/Expand_output_0 -> (-1, 4, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Constant_10 [Constant] outputs: [/encoder/4/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Mul_1 [Mul] inputs: [/encoder/4/upsample/Gather_output_0 -> ()[INT32]], [/encoder/4/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Constant_10_output_0 for ONNX node: /encoder/4/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Mul_1 for ONNX node: /encoder/4/upsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Mul_1_output_0 for ONNX tensor: /encoder/4/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Mul_1 [Mul] outputs: [/encoder/4/upsample/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6770 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6770 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6770 [Constant] outputs: [onnx::Unsqueeze_8006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8006 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/4/upsample/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8006 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_4 for ONNX node: /encoder/4/upsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6772 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6772 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6772 [Constant] outputs: [onnx::Unsqueeze_8008 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8008 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/4/upsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8008 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_5 for ONNX node: /encoder/4/upsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6774 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6774 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6774 [Constant] outputs: [onnx::Unsqueeze_8010 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8010 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/4/upsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8010 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Unsqueeze_6 for ONNX node: /encoder/4/upsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/4/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/4/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Concat_1 [Concat] inputs: [/encoder/4/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/4/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/4/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Concat_1 for ONNX node: /encoder/4/upsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Concat_1_output_0 for ONNX tensor: /encoder/4/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Concat_1 [Concat] outputs: [/encoder/4/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/upsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Reshape_1 [Reshape] inputs: [/encoder/4/upsample/Expand_output_0 -> (-1, 4, -1, 384)[FLOAT]], [/encoder/4/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/upsample/Reshape_1 for ONNX node: /encoder/4/upsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/upsample/Reshape_1_output_0 for ONNX tensor: /encoder/4/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/upsample/Reshape_1 [Reshape] outputs: [/encoder/4/upsample/Reshape_1_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant [Constant] outputs: [/encoder/4/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_1 [Constant] outputs: [/encoder/4/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Unsqueeze [Unsqueeze] inputs: [/encoder/4/downsample/Gather_output_0 -> ()[INT32]], [/encoder/4/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/Unsqueeze for ONNX node: /encoder/4/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/Unsqueeze_output_0 for ONNX tensor: /encoder/4/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Unsqueeze [Unsqueeze] outputs: [/encoder/4/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_2 [Constant] outputs: [/encoder/4/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Constant_3 [Constant] outputs: [/encoder/4/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Slice [Slice] inputs: [/encoder/4/upsample/Reshape_1_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/Constant_output_0 -> (1)[INT32]], [/encoder/4/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/4/Constant_2_output_0 -> (1)[INT32]], [/encoder/4/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/Slice for ONNX node: /encoder/4/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/Slice_output_0 for ONNX tensor: /encoder/4/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/Slice [Slice] outputs: [/encoder/4/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/out_combiner/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Sub [Sub] inputs: [/encoder/4/Slice_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/out_combiner/Sub for ONNX node: /encoder/4/out_combiner/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/out_combiner/Sub_output_0 for ONNX tensor: /encoder/4/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Sub [Sub] outputs: [/encoder/4/out_combiner/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/out_combiner/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.4.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Mul [Mul] inputs: [/encoder/4/out_combiner/Sub_output_0 -> (-1, -1, 384)[FLOAT]], [encoder.encoders.4.out_combiner.bypass_scale -> (384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.4.out_combiner.bypass_scale for ONNX node: encoder.encoders.4.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/out_combiner/Mul for ONNX node: /encoder/4/out_combiner/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/out_combiner/Mul_output_0 for ONNX tensor: /encoder/4/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Mul [Mul] outputs: [/encoder/4/out_combiner/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/4/out_combiner/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Add [Add] inputs: [/encoder/Slice_4_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/4/out_combiner/Mul_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/4/out_combiner/Add for ONNX node: /encoder/4/out_combiner/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/4/out_combiner/Add_output_0 for ONNX tensor: /encoder/4/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/4/out_combiner/Add [Add] outputs: [/encoder/4/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_32 [Constant] outputs: [/encoder/Constant_32_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_33 [Constant] outputs: [/encoder/Constant_33_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_34 [Constant] outputs: [/encoder/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_35 [Constant] outputs: [/encoder/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_5 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_5 [Slice] inputs: [/encoder/4/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/Constant_33_output_0 -> (1)[INT32]], [/encoder/Constant_34_output_0 -> (1)[INT32]], [/encoder/Constant_32_output_0 -> (1)[INT32]], [/encoder/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_5 for ONNX node: /encoder/Slice_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_5_output_0 for ONNX tensor: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_5 [Slice] outputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape [Shape] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Shape for ONNX node: /encoder/5/downsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Shape_output_0 for ONNX tensor: /encoder/5/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape [Shape] outputs: [/encoder/5/downsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant [Constant] outputs: [/encoder/5/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather [Gather] inputs: [/encoder/5/downsample/Shape_output_0 -> (3)[INT32]], [/encoder/5/downsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_output_0 for ONNX node: /encoder/5/downsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Gather for ONNX node: /encoder/5/downsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Gather_output_0 for ONNX tensor: /encoder/5/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather [Gather] outputs: [/encoder/5/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_1 [Shape] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Shape_1 for ONNX node: /encoder/5/downsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Shape_1_output_0 for ONNX tensor: /encoder/5/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_1 [Shape] outputs: [/encoder/5/downsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_1 [Constant] outputs: [/encoder/5/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather_1 [Gather] inputs: [/encoder/5/downsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/downsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_1_output_0 for ONNX node: /encoder/5/downsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Gather_1 for ONNX node: /encoder/5/downsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Gather_1_output_0 for ONNX tensor: /encoder/5/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather_1 [Gather] outputs: [/encoder/5/downsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_2 [Shape] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Shape_2 for ONNX node: /encoder/5/downsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Shape_2_output_0 for ONNX tensor: /encoder/5/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_2 [Shape] outputs: [/encoder/5/downsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_2 [Constant] outputs: [/encoder/5/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather_2 [Gather] inputs: [/encoder/5/downsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/5/downsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_2_output_0 for ONNX node: /encoder/5/downsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Gather_2 for ONNX node: /encoder/5/downsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Gather_2_output_0 for ONNX tensor: /encoder/5/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Gather_2 [Gather] outputs: [/encoder/5/downsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_3 [Constant] outputs: [/encoder/5/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Add [Add] inputs: [/encoder/5/downsample/Gather_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_3_output_0 for ONNX node: /encoder/5/downsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Add for ONNX node: /encoder/5/downsample/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Add_output_0 for ONNX tensor: /encoder/5/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Add [Add] outputs: [/encoder/5/downsample/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_4 [Constant] outputs: [/encoder/5/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub [Sub] inputs: [/encoder/5/downsample/Add_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_4_output_0 for ONNX node: /encoder/5/downsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Sub for ONNX node: /encoder/5/downsample/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Sub_output_0 for ONNX tensor: /encoder/5/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub [Sub] outputs: [/encoder/5/downsample/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_5 [Constant] outputs: [/encoder/5/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Div [Div] inputs: [/encoder/5/downsample/Sub_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_5_output_0 for ONNX node: /encoder/5/downsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Div for ONNX node: /encoder/5/downsample/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Div_output_0 for ONNX tensor: /encoder/5/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Div [Div] outputs: [/encoder/5/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Cast [Cast] inputs: [/encoder/5/downsample/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Cast for ONNX node: /encoder/5/downsample/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Cast_output_0 for ONNX tensor: /encoder/5/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Cast [Cast] outputs: [/encoder/5/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Cast_1 [Cast] inputs: [/encoder/5/downsample/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Cast_1 for ONNX node: /encoder/5/downsample/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Cast_1_output_0 for ONNX tensor: /encoder/5/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Cast_1 [Cast] outputs: [/encoder/5/downsample/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_6 [Constant] outputs: [/encoder/5/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul [Mul] inputs: [/encoder/5/downsample/Cast_1_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_6_output_0 for ONNX node: /encoder/5/downsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Mul for ONNX node: /encoder/5/downsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Mul_output_0 for ONNX tensor: /encoder/5/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul [Mul] outputs: [/encoder/5/downsample/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub_1 [Sub] inputs: [/encoder/5/downsample/Mul_output_0 -> ()[INT32]], [/encoder/5/downsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Sub_1 for ONNX node: /encoder/5/downsample/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Sub_1_output_0 for ONNX tensor: /encoder/5/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub_1 [Sub] outputs: [/encoder/5/downsample/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_7 [Constant] outputs: [/encoder/5/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub_2 [Sub] inputs: [/encoder/5/downsample/Gather_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_7_output_0 for ONNX node: /encoder/5/downsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Sub_2 for ONNX node: /encoder/5/downsample/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Sub_2_output_0 for ONNX tensor: /encoder/5/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Sub_2 [Sub] outputs: [/encoder/5/downsample/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_8 [Constant] outputs: [/encoder/5/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze [Unsqueeze] inputs: [/encoder/5/downsample/Sub_2_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze for ONNX node: /encoder/5/downsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_9 [Constant] outputs: [/encoder/5/downsample/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_10 [Constant] outputs: [/encoder/5/downsample/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_11 [Constant] outputs: [/encoder/5/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Slice [Slice] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/downsample/Constant_9_output_0 -> (1)[INT32]], [/encoder/5/downsample/Constant_10_output_0 -> (1)[INT32]], [/encoder/5/downsample/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Slice for ONNX node: /encoder/5/downsample/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Slice_output_0 for ONNX tensor: /encoder/5/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Slice [Slice] outputs: [/encoder/5/downsample/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_12 [Constant] outputs: [/encoder/5/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/downsample/Sub_1_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_1 for ONNX node: /encoder/5/downsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_13 [Constant] outputs: [/encoder/5/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/downsample/Gather_1_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_2 for ONNX node: /encoder/5/downsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_14 [Constant] outputs: [/encoder/5/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/downsample/Gather_2_output_0 -> ()[INT32]], [/encoder/5/downsample/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_3 for ONNX node: /encoder/5/downsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat [Concat] inputs: [/encoder/5/downsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/downsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/downsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Concat for ONNX node: /encoder/5/downsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Concat_output_0 for ONNX tensor: /encoder/5/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat [Concat] outputs: [/encoder/5/downsample/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_15 [Constant] outputs: [/encoder/5/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Reshape [Reshape] inputs: [/encoder/5/downsample/Concat_output_0 -> (3)[INT32]], [/encoder/5/downsample/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Reshape for ONNX node: /encoder/5/downsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Reshape_output_0 for ONNX tensor: /encoder/5/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Reshape [Reshape] outputs: [/encoder/5/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_3 [Shape] inputs: [/encoder/5/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Shape_3 for ONNX node: /encoder/5/downsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Shape_3_output_0 for ONNX tensor: /encoder/5/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Shape_3 [Shape] outputs: [/encoder/5/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/5/downsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/5/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/5/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_16 [Constant] outputs: [/encoder/5/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul_1 [Mul] inputs: [/encoder/5/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/5/downsample/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_16_output_0 for ONNX node: /encoder/5/downsample/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Mul_1 for ONNX node: /encoder/5/downsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Mul_1_output_0 for ONNX tensor: /encoder/5/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul_1 [Mul] outputs: [/encoder/5/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Equal [Equal] inputs: [/encoder/5/downsample/Reshape_output_0 -> (3)[INT32]], [/encoder/5/downsample/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Equal for ONNX node: /encoder/5/downsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Equal_output_0 for ONNX tensor: /encoder/5/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Equal [Equal] outputs: [/encoder/5/downsample/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Where [Where] inputs: [/encoder/5/downsample/Equal_output_0 -> (3)[BOOL]], [/encoder/5/downsample/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/5/downsample/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Where for ONNX node: /encoder/5/downsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Where_output_0 for ONNX tensor: /encoder/5/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Where [Where] outputs: [/encoder/5/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Expand [Expand] inputs: [/encoder/5/downsample/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Expand for ONNX node: /encoder/5/downsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Expand_output_0 for ONNX tensor: /encoder/5/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Expand [Expand] outputs: [/encoder/5/downsample/Expand_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat_1 [Concat] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/Expand_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Concat_1 for ONNX node: /encoder/5/downsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Concat_1_output_0 for ONNX tensor: /encoder/5/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat_1 [Concat] outputs: [/encoder/5/downsample/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6837 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6837 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6837 [Constant] outputs: [onnx::Unsqueeze_8077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8077 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/downsample/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_4 for ONNX node: /encoder/5/downsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Constant_17 [Constant] outputs: [/encoder/5/downsample/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6840 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6840 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6840 [Constant] outputs: [onnx::Unsqueeze_8081 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8081 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/downsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8081 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_5 for ONNX node: /encoder/5/downsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6842 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6842 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6842 [Constant] outputs: [onnx::Unsqueeze_8083 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8083 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/downsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8083 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Unsqueeze_6 for ONNX node: /encoder/5/downsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat_2 [Concat] inputs: [/encoder/5/downsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/downsample/Constant_17_output_0 -> (1)[INT32]], [/encoder/5/downsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/downsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Constant_17_output_0 for ONNX node: /encoder/5/downsample/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Concat_2 for ONNX node: /encoder/5/downsample/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Concat_2_output_0 for ONNX tensor: /encoder/5/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Concat_2 [Concat] outputs: [/encoder/5/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Reshape_1 [Reshape] inputs: [/encoder/5/downsample/Concat_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Reshape_1 for ONNX node: /encoder/5/downsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Reshape_1_output_0 for ONNX tensor: /encoder/5/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Reshape_1 [Reshape] outputs: [/encoder/5/downsample/Reshape_1_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Softmax_9710 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Softmax [Softmax] inputs: [onnx::Softmax_9710 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::Softmax_9710 for ONNX node: onnx::Softmax_9710 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Softmax for ONNX node: /encoder/5/downsample/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Softmax_output_0 for ONNX tensor: /encoder/5/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Softmax [Softmax] outputs: [/encoder/5/downsample/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul_2 [Mul] inputs: [/encoder/5/downsample/Reshape_1_output_0 -> (-1, 2, -1, 256)[FLOAT]], [/encoder/5/downsample/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/Mul_2 for ONNX node: /encoder/5/downsample/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/Mul_2_output_0 for ONNX tensor: /encoder/5/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/Mul_2 [Mul] outputs: [/encoder/5/downsample/Mul_2_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/downsample/ReduceSum [ReduceSum] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/ReduceSum [ReduceSum] inputs: [/encoder/5/downsample/Mul_2_output_0 -> (-1, 2, -1, 256)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/downsample/ReduceSum for ONNX node: /encoder/5/downsample/ReduceSum [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/downsample/ReduceSum_output_0 for ONNX tensor: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/downsample/ReduceSum [ReduceSum] outputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Shape [Shape] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Shape for ONNX node: /encoder/5/encoder/encoder_pos/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Shape_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Shape [Shape] outputs: [/encoder/5/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_1 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Gather [Gather] inputs: [/encoder/5/encoder/encoder_pos/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/encoder_pos/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Constant_1_output_0 for ONNX node: /encoder/5/encoder/encoder_pos/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Gather for ONNX node: /encoder/5/encoder/encoder_pos/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Gather_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Gather [Gather] outputs: [/encoder/5/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_2 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Sub [Sub] inputs: [/encoder/5/encoder/encoder_pos/Constant_2_output_0 -> ()[INT32]], [/encoder/5/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Constant_2_output_0 for ONNX node: /encoder/5/encoder/encoder_pos/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Sub for ONNX node: /encoder/5/encoder/encoder_pos/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Sub_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Sub [Sub] outputs: [/encoder/5/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_3 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Add [Add] inputs: [/encoder/5/encoder/encoder_pos/Sub_output_0 -> ()[INT32]], [/encoder/5/encoder/encoder_pos/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Constant_3_output_0 for ONNX node: /encoder/5/encoder/encoder_pos/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Add for ONNX node: /encoder/5/encoder/encoder_pos/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Add_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Add [Add] outputs: [/encoder/5/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_4 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Add_1 [Add] inputs: [/encoder/5/encoder/encoder_pos/Constant_4_output_0 -> ()[INT32]], [/encoder/5/encoder/encoder_pos/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Constant_4_output_0 for ONNX node: /encoder/5/encoder/encoder_pos/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Add_1 for ONNX node: /encoder/5/encoder/encoder_pos/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Add_1 [Add] outputs: [/encoder/5/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_5 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/encoder_pos/Add_output_0 -> ()[INT32]], [/encoder/5/encoder/encoder_pos/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Unsqueeze for ONNX node: /encoder/5/encoder/encoder_pos/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_6 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/encoder_pos/Add_1_output_0 -> ()[INT32]], [/encoder/5/encoder/encoder_pos/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Unsqueeze_1 for ONNX node: /encoder/5/encoder/encoder_pos/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_7 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_8 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Slice [Slice] inputs: [/encoder/5/encoder/encoder_pos/Constant_output_0 -> (9999, 48)[FLOAT]], [/encoder/5/encoder/encoder_pos/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/encoder_pos/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/encoder_pos/Constant_7_output_0 -> (1)[INT32]], [/encoder/5/encoder/encoder_pos/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Constant_output_0 for ONNX node: /encoder/5/encoder/encoder_pos/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Slice for ONNX node: /encoder/5/encoder/encoder_pos/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Slice_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Slice [Slice] outputs: [/encoder/5/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Constant_9 [Constant] outputs: [/encoder/5/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/encoder_pos/Slice_output_0 -> (-1, 48)[FLOAT]], [/encoder/5/encoder/encoder_pos/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 48), unsqueezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/encoder_pos/Unsqueeze_2 for ONNX node: /encoder/5/encoder/encoder_pos/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/encoder_pos/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9712 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9712 -> (256, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9712 for ONNX node: onnx::MatMul_9712 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/in_proj/Add for ONNX node: /encoder/5/encoder/0/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice [Slice] inputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Slice for ONNX node: /encoder/5/encoder/0/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice [Slice] outputs: [/encoder/5/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Slice_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/5/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/5/encoder/0/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Slice_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/5/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6891 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6891 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6891 [Constant] outputs: [onnx::Unsqueeze_8138 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8138 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8138 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6893 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6893 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6893 [Constant] outputs: [onnx::Unsqueeze_8140 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8140 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8140 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6898 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6898 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6898 [Constant] outputs: [onnx::Unsqueeze_8147 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8147 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8147 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6900 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6900 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6900 [Constant] outputs: [onnx::Unsqueeze_8149 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8149 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8149 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6906 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6906 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6906 [Constant] outputs: [onnx::Unsqueeze_8157 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8157 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8157 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6908 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6908 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6908 [Constant] outputs: [onnx::Unsqueeze_8159 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8159 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8159 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose [Transpose] inputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Transpose for ONNX node: /encoder/5/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose [Transpose] outputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Transpose_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Transpose_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/MatMul [MatMul] inputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/MatMul for ONNX node: /encoder/5/encoder/0/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9719 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9719 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9719 for ONNX node: onnx::MatMul_9719 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Mul [Mul] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Mul for ONNX node: /encoder/5/encoder/0/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Mul [Mul] outputs: [/encoder/5/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Sub [Sub] inputs: [/encoder/5/encoder/0/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Sub for ONNX node: /encoder/5/encoder/0/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Sub [Sub] outputs: [/encoder/5/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6925 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6925 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6925 [Constant] outputs: [onnx::Unsqueeze_8180 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8180 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_8180 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Transpose_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/5/encoder/0/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/MatMul_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather_3 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_4 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather_4 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_5 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Gather_5 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/5/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Sub_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast [Cast] inputs: [/encoder/5/encoder/0/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Cast for ONNX node: /encoder/5/encoder/0/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast [Cast] outputs: [/encoder/5/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Range [Range] inputs: [/encoder/5/encoder/0/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Range for ONNX node: /encoder/5/encoder/0/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Range [Range] outputs: [/encoder/5/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Cast_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/5/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Range_1 [Range] inputs: [/encoder/5/encoder/0/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Range_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Range_1 [Range] outputs: [/encoder/5/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Mul_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6956 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6956 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6956 [Constant] outputs: [onnx::Unsqueeze_8213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8213 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8213 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_4 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6959 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6959 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6959 [Constant] outputs: [onnx::Unsqueeze_8216 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8216 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8216 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_5 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Shape_6 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/5/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/5/encoder/0/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/5/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Expand [Expand] inputs: [/encoder/5/encoder/0/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Expand for ONNX node: /encoder/5/encoder/0/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Expand [Expand] outputs: [/encoder/5/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Tile [Tile] inputs: [/encoder/5/encoder/0/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Tile for ONNX node: /encoder/5/encoder/0/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Tile [Tile] outputs: [/encoder/5/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Add [Add] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Add for ONNX node: /encoder/5/encoder/0/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Add [Add] outputs: [/encoder/5/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6970 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6970 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6970 [Constant] outputs: [onnx::Unsqueeze_8228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8228 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_8228 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_6 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape_4 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/GatherElements for ONNX node: /encoder/5/encoder/0/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/5/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6975 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6975 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6975 [Constant] outputs: [onnx::Unsqueeze_8233 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8233 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8233 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6977 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6977 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6977 [Constant] outputs: [onnx::Unsqueeze_8235 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8235 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8235 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6979 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6979 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6979 [Constant] outputs: [onnx::Unsqueeze_8237 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8237 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8237 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_6981 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_6981 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_6981 [Constant] outputs: [onnx::Unsqueeze_8239 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8239 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8239 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Concat_7 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/5/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/5/encoder/0/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Reshape_5 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/5/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Add_1 [Add] inputs: [/encoder/5/encoder/0/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Add_1 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Add_1 [Add] outputs: [/encoder/5/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Cast_2 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/5/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Where [Where] inputs: [/encoder/5/encoder/0/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/5/encoder/0/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Where for ONNX node: /encoder/5/encoder/0/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Where [Where] outputs: [/encoder/5/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Softmax [Softmax] inputs: [/encoder/5/encoder/0/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn_weights/Softmax for ONNX node: /encoder/5/encoder/0/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn_weights/Softmax [Softmax] outputs: [/encoder/5/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9726 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9726 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9726 for ONNX node: onnx::MatMul_9726 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias -> (576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/in_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Sub for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Exp for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Add [Add] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Log [Log] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Log for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Log [Log] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Cast for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Equal for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Where [Where] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Where for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Where [Where] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/0/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Mul for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9727 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [onnx::MatMul_9727 -> (576, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9727 for ONNX node: onnx::MatMul_9727 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add [Add] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add for ONNX node: /encoder/5/encoder/0/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add [Add] outputs: [/encoder/5/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant [Constant] outputs: [/encoder/5/encoder/0/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Slice [Slice] inputs: [/encoder/5/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/Constant_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/Constant_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Slice for ONNX node: /encoder/5/encoder/0/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Slice_output_0 for ONNX tensor: /encoder/5/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Slice [Slice] outputs: [/encoder/5/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9728 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9728 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9728 for ONNX node: onnx::MatMul_9728 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias -> (576)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/in_proj/Add for ONNX node: /encoder/5/encoder/0/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape [Shape] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Add [Add] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Add for ONNX node: /encoder/5/encoder/0/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Add [Add] outputs: [/encoder/5/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Div [Div] inputs: [/encoder/5/encoder/0/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Div for ONNX node: /encoder/5/encoder/0/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Div [Div] outputs: [/encoder/5/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul [Mul] inputs: [/encoder/5/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Mul for ONNX node: /encoder/5/encoder/0/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul [Mul] outputs: [/encoder/5/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice [Slice] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Slice for ONNX node: /encoder/5/encoder/0/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice [Slice] outputs: [/encoder/5/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/5/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Mul_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Slice_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/5/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/5/encoder/0/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Mul_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/5/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/5/encoder/0/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Slice_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/5/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/5/encoder/0/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh for ONNX node: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/5/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 192), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7043 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7043 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7043 [Constant] outputs: [onnx::Unsqueeze_8304 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8304 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8304 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7045 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7045 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7045 [Constant] outputs: [onnx::Unsqueeze_8306 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8306 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8306 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat [Concat] inputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Concat for ONNX node: /encoder/5/encoder/0/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat [Concat] outputs: [/encoder/5/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape [Reshape] inputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Reshape for ONNX node: /encoder/5/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape [Reshape] outputs: [/encoder/5/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/5/encoder/0/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Mul_3 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape_3 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather_3 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape_4 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather_4 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/5/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Shape_5 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/5/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/5/encoder/0/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Gather_5 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/5/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7060 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7060 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7060 [Constant] outputs: [onnx::Unsqueeze_8322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8322 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8322 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7062 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7062 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7062 [Constant] outputs: [onnx::Unsqueeze_8324 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8324 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8324 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7064 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7064 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7064 [Constant] outputs: [onnx::Unsqueeze_8326 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8326 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_8326 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Concat_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/5/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/0/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Reshape_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Transpose [Transpose] inputs: [/encoder/5/encoder/0/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Transpose for ONNX node: /encoder/5/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Transpose [Transpose] outputs: [/encoder/5/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/MatMul for ONNX node: /encoder/5/encoder/0/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/MatMul [MatMul] outputs: [/encoder/5/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Transpose_1 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7072 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7072 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7072 [Constant] outputs: [onnx::Unsqueeze_8335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8335 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8335 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7074 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7074 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7074 [Constant] outputs: [onnx::Unsqueeze_8337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8337 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/5/encoder/0/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8337 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/5/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Concat_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/5/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/5/encoder/0/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Reshape_2 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/5/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/5/encoder/0/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/Mul_4 for ONNX node: /encoder/5/encoder/0/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/5/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9732 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9732 -> (192, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9732 for ONNX node: onnx::MatMul_9732 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/nonlin_attention/out_proj/Add for ONNX node: /encoder/5/encoder/0/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_1 [Add] inputs: [/encoder/5/encoder/0/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_1 for ONNX node: /encoder/5/encoder/0/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_1 [Add] outputs: [/encoder/5/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape [Shape] inputs: [/encoder/5/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Shape for ONNX node: /encoder/5/encoder/0/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape [Shape] outputs: [/encoder/5/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant [Constant] outputs: [/encoder/5/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather [Gather] inputs: [/encoder/5/encoder/0/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Constant_output_0 for ONNX node: /encoder/5/encoder/0/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Gather for ONNX node: /encoder/5/encoder/0/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather [Gather] outputs: [/encoder/5/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Shape_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_1 [Gather] inputs: [/encoder/5/encoder/0/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Gather_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_1 [Gather] outputs: [/encoder/5/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_2 [Shape] inputs: [/encoder/5/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Shape_2 for ONNX node: /encoder/5/encoder/0/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_2 [Shape] outputs: [/encoder/5/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_2 [Gather] inputs: [/encoder/5/encoder/0/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Gather_2 for ONNX node: /encoder/5/encoder/0/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_2 [Gather] outputs: [/encoder/5/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9733 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9733 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9733 for ONNX node: onnx::MatMul_9733 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/5/encoder/0/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/in_proj/Add for ONNX node: /encoder/5/encoder/0/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7094 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7094 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7094 [Constant] outputs: [onnx::Unsqueeze_8360 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8360 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8360 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7096 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7096 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7096 [Constant] outputs: [onnx::Unsqueeze_8362 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8362 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8362 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7098 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7098 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7098 [Constant] outputs: [onnx::Unsqueeze_8364 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8364 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8364 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze_2 for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Concat [Concat] inputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Concat for ONNX node: /encoder/5/encoder/0/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Concat_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Concat [Concat] outputs: [/encoder/5/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Reshape [Reshape] inputs: [/encoder/5/encoder/0/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/5/encoder/0/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Reshape for ONNX node: /encoder/5/encoder/0/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Reshape [Reshape] outputs: [/encoder/5/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Transpose [Transpose] inputs: [/encoder/5/encoder/0/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Transpose for ONNX node: /encoder/5/encoder/0/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Transpose [Transpose] outputs: [/encoder/5/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_3 [Shape] inputs: [/encoder/5/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Shape_3 for ONNX node: /encoder/5/encoder/0/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Shape_3 [Shape] outputs: [/encoder/5/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_3 [Gather] inputs: [/encoder/5/encoder/0/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Gather_3 for ONNX node: /encoder/5/encoder/0/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Gather_3 [Gather] outputs: [/encoder/5/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/MatMul [MatMul] inputs: [/encoder/5/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/MatMul for ONNX node: /encoder/5/encoder/0/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Transpose_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Mul [Mul] inputs: [/encoder/5/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Mul for ONNX node: /encoder/5/encoder/0/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Mul [Mul] outputs: [/encoder/5/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7110 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7110 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7110 [Constant] outputs: [onnx::Unsqueeze_8377 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8377 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8377 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze_3 for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7112 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7112 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7112 [Constant] outputs: [onnx::Unsqueeze_8379 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8379 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8379 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze_4 for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7114 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7114 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7114 [Constant] outputs: [onnx::Unsqueeze_8381 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8381 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_8381 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Unsqueeze_5 for ONNX node: /encoder/5/encoder/0/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Concat_1 [Concat] inputs: [/encoder/5/encoder/0/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Concat_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Concat_1 [Concat] outputs: [/encoder/5/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/0/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/5/encoder/0/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/Reshape_1 for ONNX node: /encoder/5/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9735 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9735 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9735 for ONNX node: onnx::MatMul_9735 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn1/out_proj/Add for ONNX node: /encoder/5/encoder/0/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn1/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_2 [Add] inputs: [/encoder/5/encoder/0/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_2 for ONNX node: /encoder/5/encoder/0/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_2_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_2 [Add] outputs: [/encoder/5/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9736 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9736 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9736 for ONNX node: onnx::MatMul_9736 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias -> (512)[FLOAT]], [/encoder/5/encoder/0/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/in_proj/Add for ONNX node: /encoder/5/encoder/0/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Shape [Shape] inputs: [/encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Shape for ONNX node: /encoder/5/encoder/0/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Shape [Shape] outputs: [/encoder/5/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Gather [Gather] inputs: [/encoder/5/encoder/0/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Gather for ONNX node: /encoder/5/encoder/0/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Gather [Gather] outputs: [/encoder/5/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Add [Add] inputs: [/encoder/5/encoder/0/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Add for ONNX node: /encoder/5/encoder/0/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Add [Add] outputs: [/encoder/5/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Div [Div] inputs: [/encoder/5/encoder/0/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Div for ONNX node: /encoder/5/encoder/0/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Div_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Div [Div] outputs: [/encoder/5/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul [Mul] inputs: [/encoder/5/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Mul for ONNX node: /encoder/5/encoder/0/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul [Mul] outputs: [/encoder/5/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Slice [Slice] inputs: [/encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/0/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Slice for ONNX node: /encoder/5/encoder/0/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Slice_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Slice [Slice] outputs: [/encoder/5/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_5 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul_1 [Mul] inputs: [/encoder/5/encoder/0/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_5_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Mul_1 for ONNX node: /encoder/5/encoder/0/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul_1 [Mul] outputs: [/encoder/5/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Slice_1 [Slice] inputs: [/encoder/5/encoder/0/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/0/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Slice_1 for ONNX node: /encoder/5/encoder/0/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Slice_1 [Slice] outputs: [/encoder/5/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/5/encoder/0/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul_2 [Mul] inputs: [/encoder/5/encoder/0/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Mul_2 for ONNX node: /encoder/5/encoder/0/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Mul_2 [Mul] outputs: [/encoder/5/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Transpose [Transpose] inputs: [/encoder/5/encoder/0/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Transpose for ONNX node: /encoder/5/encoder/0/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Transpose [Transpose] outputs: [/encoder/5/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Shape_1 for ONNX node: /encoder/5/encoder/0/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/0/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Expand for ONNX node: /encoder/5/encoder/0/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Expand_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Expand [Expand] outputs: [/encoder/5/encoder/0/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Cast [Cast] inputs: [/encoder/5/encoder/0/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Cast for ONNX node: /encoder/5/encoder/0/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Cast [Cast] outputs: [/encoder/5/encoder/0/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Constant_6 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Where [Where] inputs: [/encoder/5/encoder/0/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/5/encoder/0/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/5/encoder/0/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Constant_6_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Where for ONNX node: /encoder/5/encoder/0/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Where [Where] outputs: [/encoder/5/encoder/0/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/5/encoder/0/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.5.encoder.layers.0.conv_module1.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/5/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/Transpose_1 for ONNX node: /encoder/5/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Sub for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Exp for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Add [Add] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Add for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Log [Log] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Log for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Log [Log] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Cast for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Equal for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Where [Where] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/5/encoder/0/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Where for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Where [Where] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/0/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Mul for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9737 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9737 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9737 for ONNX node: onnx::MatMul_9737 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module1/out_proj/Add_1 for ONNX node: /encoder/5/encoder/0/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_3 [Add] inputs: [/encoder/5/encoder/0/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_3 for ONNX node: /encoder/5/encoder/0/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_3_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_3 [Add] outputs: [/encoder/5/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9738 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9738 -> (256, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9738 for ONNX node: onnx::MatMul_9738 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias -> (768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/in_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Sub for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Exp for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Add [Add] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Log [Log] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Log for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Log [Log] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Cast for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Equal for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Where [Where] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Where for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Where [Where] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/0/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Mul for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9739 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9739 -> (768, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9739 for ONNX node: onnx::MatMul_9739 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_4 [Add] inputs: [/encoder/5/encoder/0/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_4 for ONNX node: /encoder/5/encoder/0/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_4_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_4 [Add] outputs: [/encoder/5/encoder/0/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Sub [Sub] inputs: [/encoder/5/encoder/0/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass_mid/Sub for ONNX node: /encoder/5/encoder/0/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Sub [Sub] outputs: [/encoder/5/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Mul [Mul] inputs: [/encoder/5/encoder/0/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale for ONNX node: encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass_mid/Mul for ONNX node: /encoder/5/encoder/0/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Mul [Mul] outputs: [/encoder/5/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Add [Add] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass_mid/Add for ONNX node: /encoder/5/encoder/0/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass_mid/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass_mid/Add [Add] outputs: [/encoder/5/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape [Shape] inputs: [/encoder/5/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Shape for ONNX node: /encoder/5/encoder/0/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape [Shape] outputs: [/encoder/5/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant [Constant] outputs: [/encoder/5/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather [Gather] inputs: [/encoder/5/encoder/0/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Constant_output_0 for ONNX node: /encoder/5/encoder/0/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Gather for ONNX node: /encoder/5/encoder/0/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather [Gather] outputs: [/encoder/5/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Shape_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather_1 [Gather] inputs: [/encoder/5/encoder/0/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Gather_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather_1 [Gather] outputs: [/encoder/5/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9740 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9740 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9740 for ONNX node: onnx::MatMul_9740 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/5/encoder/0/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/in_proj/Add for ONNX node: /encoder/5/encoder/0/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7196 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7196 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7196 [Constant] outputs: [onnx::Unsqueeze_8469 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8469 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8469 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7198 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7198 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7198 [Constant] outputs: [onnx::Unsqueeze_8471 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8471 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8471 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7200 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7200 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7200 [Constant] outputs: [onnx::Unsqueeze_8473 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8473 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8473 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze_2 for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Concat [Concat] inputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Concat for ONNX node: /encoder/5/encoder/0/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Concat_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Concat [Concat] outputs: [/encoder/5/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Reshape [Reshape] inputs: [/encoder/5/encoder/0/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/5/encoder/0/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Reshape for ONNX node: /encoder/5/encoder/0/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Reshape [Reshape] outputs: [/encoder/5/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Transpose [Transpose] inputs: [/encoder/5/encoder/0/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Transpose for ONNX node: /encoder/5/encoder/0/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Transpose [Transpose] outputs: [/encoder/5/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape_2 [Shape] inputs: [/encoder/5/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Shape_2 for ONNX node: /encoder/5/encoder/0/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Shape_2 [Shape] outputs: [/encoder/5/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather_2 [Gather] inputs: [/encoder/5/encoder/0/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/0/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Gather_2 for ONNX node: /encoder/5/encoder/0/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Gather_2 [Gather] outputs: [/encoder/5/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/MatMul [MatMul] inputs: [/encoder/5/encoder/0/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/0/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/MatMul for ONNX node: /encoder/5/encoder/0/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Transpose_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Mul [Mul] inputs: [/encoder/5/encoder/0/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/5/encoder/0/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Mul for ONNX node: /encoder/5/encoder/0/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Mul [Mul] outputs: [/encoder/5/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7212 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7212 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7212 [Constant] outputs: [onnx::Unsqueeze_8486 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8486 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8486 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze_3 for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7214 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7214 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7214 [Constant] outputs: [onnx::Unsqueeze_8488 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8488 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8488 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze_4 for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7216 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7216 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7216 [Constant] outputs: [onnx::Unsqueeze_8490 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8490 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/0/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_8490 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Unsqueeze_5 for ONNX node: /encoder/5/encoder/0/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Concat_1 [Concat] inputs: [/encoder/5/encoder/0/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Concat_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Concat_1 [Concat] outputs: [/encoder/5/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/0/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/5/encoder/0/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/Reshape_1 for ONNX node: /encoder/5/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9742 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9742 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9742 for ONNX node: onnx::MatMul_9742 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/self_attn2/out_proj/Add for ONNX node: /encoder/5/encoder/0/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/self_attn2/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_5 [Add] inputs: [/encoder/5/encoder/0/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_5 for ONNX node: /encoder/5/encoder/0/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_5_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_5 [Add] outputs: [/encoder/5/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9743 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9743 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9743 for ONNX node: onnx::MatMul_9743 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias -> (512)[FLOAT]], [/encoder/5/encoder/0/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/in_proj/Add for ONNX node: /encoder/5/encoder/0/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Shape [Shape] inputs: [/encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Shape for ONNX node: /encoder/5/encoder/0/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Shape_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Shape [Shape] outputs: [/encoder/5/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Gather [Gather] inputs: [/encoder/5/encoder/0/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Gather for ONNX node: /encoder/5/encoder/0/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Gather_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Gather [Gather] outputs: [/encoder/5/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Add [Add] inputs: [/encoder/5/encoder/0/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Add for ONNX node: /encoder/5/encoder/0/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Add [Add] outputs: [/encoder/5/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Div [Div] inputs: [/encoder/5/encoder/0/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Div for ONNX node: /encoder/5/encoder/0/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Div_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Div [Div] outputs: [/encoder/5/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul [Mul] inputs: [/encoder/5/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Mul for ONNX node: /encoder/5/encoder/0/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul [Mul] outputs: [/encoder/5/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Slice [Slice] inputs: [/encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/0/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Slice for ONNX node: /encoder/5/encoder/0/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Slice_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Slice [Slice] outputs: [/encoder/5/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_5 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul_1 [Mul] inputs: [/encoder/5/encoder/0/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_5_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Mul_1 for ONNX node: /encoder/5/encoder/0/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul_1 [Mul] outputs: [/encoder/5/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Slice_1 [Slice] inputs: [/encoder/5/encoder/0/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/0/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/0/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Slice_1 for ONNX node: /encoder/5/encoder/0/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Slice_1 [Slice] outputs: [/encoder/5/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/5/encoder/0/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul_2 [Mul] inputs: [/encoder/5/encoder/0/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Mul_2 for ONNX node: /encoder/5/encoder/0/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Mul_2 [Mul] outputs: [/encoder/5/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Transpose [Transpose] inputs: [/encoder/5/encoder/0/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Transpose for ONNX node: /encoder/5/encoder/0/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Transpose [Transpose] outputs: [/encoder/5/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Shape_1 [Shape] inputs: [/encoder/5/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Shape_1 for ONNX node: /encoder/5/encoder/0/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Shape_1 [Shape] outputs: [/encoder/5/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/0/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Expand for ONNX node: /encoder/5/encoder/0/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Expand_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Expand [Expand] outputs: [/encoder/5/encoder/0/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Cast [Cast] inputs: [/encoder/5/encoder/0/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Cast for ONNX node: /encoder/5/encoder/0/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Cast [Cast] outputs: [/encoder/5/encoder/0/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Constant_6 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Where [Where] inputs: [/encoder/5/encoder/0/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/5/encoder/0/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/5/encoder/0/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Constant_6_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Where for ONNX node: /encoder/5/encoder/0/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Where [Where] outputs: [/encoder/5/encoder/0/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/5/encoder/0/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.5.encoder.layers.0.conv_module2.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/5/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/0/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/Transpose_1 for ONNX node: /encoder/5/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Sub for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Exp for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Add [Add] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Add for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Log [Log] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Log for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Log [Log] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Cast for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Equal for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Where [Where] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/5/encoder/0/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Where for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Where [Where] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/0/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Mul for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9744 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9744 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9744 for ONNX node: onnx::MatMul_9744 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/conv_module2/out_proj/Add_1 for ONNX node: /encoder/5/encoder/0/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_6 [Add] inputs: [/encoder/5/encoder/0/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_6 for ONNX node: /encoder/5/encoder/0/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_6_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_6 [Add] outputs: [/encoder/5/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9745 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9745 -> (256, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9745 for ONNX node: onnx::MatMul_9745 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias -> (960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/in_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/in_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Sub for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Exp for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Add [Add] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Add for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Add [Add] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Log [Log] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Log for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Log [Log] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Cast for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Equal for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Where [Where] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Where for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Where [Where] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/0/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Mul for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9746 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [onnx::MatMul_9746 -> (960, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9746 for ONNX node: onnx::MatMul_9746 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_7 [Add] inputs: [/encoder/5/encoder/0/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/Add_7 for ONNX node: /encoder/5/encoder/0/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/Add_7_output_0 for ONNX tensor: /encoder/5/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/Add_7 [Add] outputs: [/encoder/5/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Sub [Sub] inputs: [/encoder/5/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.0.norm.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.norm.bias for ONNX node: encoder.encoders.5.encoder.layers.0.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Sub for ONNX node: /encoder/5/encoder/0/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Sub [Sub] outputs: [/encoder/5/encoder/0/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Constant [Constant] outputs: [/encoder/5/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Pow [Pow] inputs: [/encoder/5/encoder/0/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Constant_output_0 for ONNX node: /encoder/5/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Pow for ONNX node: /encoder/5/encoder/0/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Pow_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Pow [Pow] outputs: [/encoder/5/encoder/0/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/ReduceMean [ReduceMean] inputs: [/encoder/5/encoder/0/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/ReduceMean for ONNX node: /encoder/5/encoder/0/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/ReduceMean_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/ReduceMean [ReduceMean] outputs: [/encoder/5/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Constant_1 [Constant] outputs: [/encoder/5/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Pow_1 [Pow] inputs: [/encoder/5/encoder/0/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/5/encoder/0/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Constant_1_output_0 for ONNX node: /encoder/5/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Pow_1 for ONNX node: /encoder/5/encoder/0/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Pow_1_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Pow_1 [Pow] outputs: [/encoder/5/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Exp [Exp] inputs: [encoder.encoders.5.encoder.layers.0.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.norm.log_scale for ONNX node: encoder.encoders.5.encoder.layers.0.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Exp for ONNX node: /encoder/5/encoder/0/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Exp_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Exp [Exp] outputs: [/encoder/5/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Mul [Mul] inputs: [/encoder/5/encoder/0/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/5/encoder/0/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Mul for ONNX node: /encoder/5/encoder/0/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Mul [Mul] outputs: [/encoder/5/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Mul_1 [Mul] inputs: [/encoder/5/encoder/0/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/norm/Mul_1 for ONNX node: /encoder/5/encoder/0/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/norm/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/norm/Mul_1 [Mul] outputs: [/encoder/5/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Sub [Sub] inputs: [/encoder/5/encoder/0/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass/Sub for ONNX node: /encoder/5/encoder/0/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass/Sub_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Sub [Sub] outputs: [/encoder/5/encoder/0/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Mul [Mul] inputs: [/encoder/5/encoder/0/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.0.bypass.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.0.bypass.bypass_scale for ONNX node: encoder.encoders.5.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass/Mul for ONNX node: /encoder/5/encoder/0/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass/Mul_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Mul [Mul] outputs: [/encoder/5/encoder/0/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/0/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Add [Add] inputs: [/encoder/5/downsample/ReduceSum_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/0/bypass/Add for ONNX node: /encoder/5/encoder/0/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/0/bypass/Add_output_0 for ONNX tensor: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/0/bypass/Add [Add] outputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9747 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9747 -> (256, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9747 for ONNX node: onnx::MatMul_9747 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias -> (272)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/in_proj/MatMul_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/in_proj/Add for ONNX node: /encoder/5/encoder/1/self_attn_weights/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_1 [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_1 [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_5 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice [Slice] inputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Constant_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Slice for ONNX node: /encoder/5/encoder/1/self_attn_weights/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Slice_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice [Slice] outputs: [/encoder/5/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_6 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_7 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_8 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_9 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice_1 [Slice] inputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Constant_7_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_8_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Slice_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice_1 [Slice] outputs: [/encoder/5/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_10 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_11 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_12 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_13 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice_2 [Slice] inputs: [/encoder/5/encoder/1/self_attn_weights/in_proj/Add_output_0 -> (-1, -1, 272)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Constant_11_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_12_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_10_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Slice_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Slice_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Slice_2 [Slice] outputs: [/encoder/5/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7322 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7322 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7322 [Constant] outputs: [onnx::Unsqueeze_8602 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8602 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8602 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7324 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7324 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7324 [Constant] outputs: [onnx::Unsqueeze_8604 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8604 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8604 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_14 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_15 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_14_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_14_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_15_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7329 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7329 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7329 [Constant] outputs: [onnx::Unsqueeze_8611 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8611 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8611 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7331 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7331 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7331 [Constant] outputs: [onnx::Unsqueeze_8613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8613 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8613 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_16 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_17 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_1 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_16_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_16_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_17_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_1 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/Slice_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7337 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7337 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7337 [Constant] outputs: [onnx::Unsqueeze_8621 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8621 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8621 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7339 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7339 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7339 [Constant] outputs: [onnx::Unsqueeze_8623 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8623 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8623 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_18 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_18 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_18 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_19 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_19 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_19 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_2 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_18_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_19_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_18_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_18_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_19_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_19_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_2 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/Slice_2_output_0 -> (-1, -1, 16)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_2 [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/Slice_1_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_2 [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose [Transpose] inputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Transpose for ONNX node: /encoder/5/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose [Transpose] outputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_1_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Transpose_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Transpose_2 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_2 [Transpose] inputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_2_output_0 -> (-1, -1, 4, 32)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Transpose_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_2 [Transpose] outputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Transpose_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/MatMul [MatMul] inputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_output_0 -> (4, -1, -1, 32)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Transpose_2_output_0 -> (4, -1, 32, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/MatMul for ONNX node: /encoder/5/encoder/1/self_attn_weights/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9754 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] inputs: [/encoder/5/encoder/encoder_pos/Unsqueeze_2_output_0 -> (1, -1, 48)[FLOAT]], [onnx::MatMul_9754 -> (48, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9754 for ONNX node: onnx::MatMul_9754 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul for ONNX node: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_20 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_20 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_20 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Mul [Mul] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_20_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_20_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_20_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Mul for ONNX node: /encoder/5/encoder/1/self_attn_weights/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Mul [Mul] outputs: [/encoder/5/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_21 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_21 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_21 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Sub [Sub] inputs: [/encoder/5/encoder/1/self_attn_weights/Mul_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_21_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_21_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_21_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Sub for ONNX node: /encoder/5/encoder/1/self_attn_weights/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Sub [Sub] outputs: [/encoder/5/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_22 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_22 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_22 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7356 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7356 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7356 [Constant] outputs: [onnx::Unsqueeze_8644 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8644 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Sub_output_0 -> ()[INT32]], [onnx::Unsqueeze_8644 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_23 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_23 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_23 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_24 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_24 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_24 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_3 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_3 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Constant_22_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_23_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_24_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_22_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_22_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_23_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_23_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_24_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_24_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_3 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape_3 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_3 [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/linear_pos/MatMul_output_0 -> (1, -1, 16)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_3 [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Transpose_3 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_3 [Transpose] inputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_3_output_0 -> (-1, -1, 4, 4)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Transpose_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Transpose_3 [Transpose] outputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/MatMul_1 [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Transpose_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/MatMul_1 [MatMul] inputs: [/encoder/5/encoder/1/self_attn_weights/Transpose_1_output_0 -> (4, -1, -1, 4)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Transpose_3_output_0 -> (4, -1, 4, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/MatMul_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/MatMul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/MatMul_1 [MatMul] outputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_2 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_2 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_25 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_25 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_25 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_2 [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_25_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_25_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_25_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_2 [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_3 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_3 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_26 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_26 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_26 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_3 [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_3_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_26_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_26_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_26_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather_3 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_3 [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_4 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_4 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_4 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_27 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_27 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_27 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_4 [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_4_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_27_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_27_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_27_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather_4 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_4 [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_5 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_5 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_5 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_28 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_28 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_28 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_5 [Gather] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_5_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_28_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_28_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_28_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Gather_5 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Gather_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Gather_5 [Gather] outputs: [/encoder/5/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_29 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_29 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_29 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_29_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_29_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_29_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Sub_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast [Cast] inputs: [/encoder/5/encoder/1/self_attn_weights/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Cast for ONNX node: /encoder/5/encoder/1/self_attn_weights/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast [Cast] outputs: [/encoder/5/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_30 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_30 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_30 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_31 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_31 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_31 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Range [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_30_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_31_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Range [Range] inputs: [/encoder/5/encoder/1/self_attn_weights/Cast_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_30_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_31_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Range for ONNX node: /encoder/5/encoder/1/self_attn_weights/Range [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Range_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Range [Range] outputs: [/encoder/5/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast_1 [Cast] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Cast_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Cast_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast_1 [Cast] outputs: [/encoder/5/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_32 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_32 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_32 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_33 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_33 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_33 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Range_1 [Range] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_32_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_33_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Range_1 [Range] inputs: [/encoder/5/encoder/1/self_attn_weights/Constant_32_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Cast_1_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_33_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Range_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Range_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Range_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Range_1 [Range] outputs: [/encoder/5/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Mul_1 [Mul] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Mul_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Mul_1 [Mul] outputs: [/encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7387 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7387 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7387 [Constant] outputs: [onnx::Unsqueeze_8677 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8677 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8677 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_4 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_4 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_4 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_4 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7390 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7390 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7390 [Constant] outputs: [onnx::Unsqueeze_8680 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8680 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8680 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_5 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_5 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_5 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_5 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Shape_6 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_6 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/Concat_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Shape_6 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Shape_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Shape_6_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Shape_6 [Shape] outputs: [/encoder/5/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Shape_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] inputs: [/encoder/5/encoder/1/self_attn_weights/Shape_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/ConstantOfShape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/ConstantOfShape [ConstantOfShape] outputs: [/encoder/5/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Range_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Expand [Expand] inputs: [/encoder/5/encoder/1/self_attn_weights/Range_output_0 -> (-1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/ConstantOfShape_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Expand for ONNX node: /encoder/5/encoder/1/self_attn_weights/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Expand_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Expand [Expand] outputs: [/encoder/5/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Tile [Tile] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Tile [Tile] inputs: [/encoder/5/encoder/1/self_attn_weights/Expand_output_0 -> (-1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Concat_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Tile for ONNX node: /encoder/5/encoder/1/self_attn_weights/Tile [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Tile_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Tile [Tile] outputs: [/encoder/5/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_34 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_34 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_34 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Tile_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_34_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Tile_output_0 -> (-1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Constant_34_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Range_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Add [Add] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_9_output_0 -> (-1, 1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Range_1_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Add for ONNX node: /encoder/5/encoder/1/self_attn_weights/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Add [Add] outputs: [/encoder/5/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_35 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_35 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_35 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7401 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7401 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7401 [Constant] outputs: [onnx::Unsqueeze_8692 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8692 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_8692 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_6 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Constant_35_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_35_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_35_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_6 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_6_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_6 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape_4 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_4 [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_6_output_0 -> (2)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape_4 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_4 [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/GatherElements [GatherElements] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/GatherElements [GatherElements] inputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_4_output_0 -> (-1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Add_output_0 -> (-1, -1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 1 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/GatherElements for ONNX node: /encoder/5/encoder/1/self_attn_weights/GatherElements [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/GatherElements_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/GatherElements [GatherElements] outputs: [/encoder/5/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7406 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7406 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7406 [Constant] outputs: [onnx::Unsqueeze_8697 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8697 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8697 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7408 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7408 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7408 [Constant] outputs: [onnx::Unsqueeze_8699 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8699 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8699 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7410 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7410 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7410 [Constant] outputs: [onnx::Unsqueeze_8701 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8701 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8701 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7412 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7412 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7412 [Constant] outputs: [onnx::Unsqueeze_8703 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8703 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn_weights/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8703 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Concat_7 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Unsqueeze_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_7 [Concat] inputs: [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_11_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_12_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_13_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn_weights/Unsqueeze_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Concat_7 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Concat_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Concat_7_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Concat_7 [Concat] outputs: [/encoder/5/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Reshape_5 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/GatherElements_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Concat_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_5 [Reshape] inputs: [/encoder/5/encoder/1/self_attn_weights/GatherElements_output_0 -> (-1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Concat_7_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Reshape_5 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Reshape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Reshape_5 [Reshape] outputs: [/encoder/5/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Reshape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Add_1 [Add] inputs: [/encoder/5/encoder/1/self_attn_weights/MatMul_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Reshape_5_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Add_1 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Add_1 [Add] outputs: [/encoder/5/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Cast_2 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast_2 [Cast] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Cast_2 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Cast_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Cast_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Cast_2 [Cast] outputs: [/encoder/5/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Constant_36 [Constant] outputs: [/encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Cast_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Where [Where] inputs: [/encoder/5/encoder/1/self_attn_weights/Cast_2_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 -> ()[FLOAT]], [/encoder/5/encoder/1/self_attn_weights/Add_1_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 for ONNX node: /encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Where for ONNX node: /encoder/5/encoder/1/self_attn_weights/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Where [Where] outputs: [/encoder/5/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn_weights/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Softmax [Softmax] inputs: [/encoder/5/encoder/1/self_attn_weights/Where_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn_weights/Softmax for ONNX node: /encoder/5/encoder/1/self_attn_weights/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn_weights/Softmax [Softmax] outputs: [/encoder/5/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9761 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9761 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9761 for ONNX node: onnx::MatMul_9761 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias -> (576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/in_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Sub for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Exp for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Add [Add] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Exp_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Log [Log] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Log for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Log [Log] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Log_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Cast for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Equal for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Where [Where] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Equal_output_0 -> (-1, -1, 576)[BOOL]], [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Cast_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Where for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Where [Where] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/1/feed_forward1/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Mul for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Where_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Mul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_1_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9762 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Sub_2_output_0 -> (-1, -1, 576)[FLOAT]], [onnx::MatMul_9762 -> (576, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9762 for ONNX node: onnx::MatMul_9762 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1 for ONNX node: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward1/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add [Add] inputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/feed_forward1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add for ONNX node: /encoder/5/encoder/1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add [Add] outputs: [/encoder/5/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant [Constant] outputs: [/encoder/5/encoder/1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Slice [Slice] inputs: [/encoder/5/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/Constant_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/Constant_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Slice for ONNX node: /encoder/5/encoder/1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Slice_output_0 for ONNX tensor: /encoder/5/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Slice [Slice] outputs: [/encoder/5/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9763 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9763 -> (256, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9763 for ONNX node: onnx::MatMul_9763 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias -> (576)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/in_proj/MatMul_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/in_proj/Add for ONNX node: /encoder/5/encoder/1/nonlin_attention/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape [Shape] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_1 [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_1 [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_2 [Shape] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_2 [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_2 [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_2_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_2 [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Add [Add] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Add for ONNX node: /encoder/5/encoder/1/nonlin_attention/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Add [Add] outputs: [/encoder/5/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_5 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Div [Div] inputs: [/encoder/5/encoder/1/nonlin_attention/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_5_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Div for ONNX node: /encoder/5/encoder/1/nonlin_attention/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Div_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Div [Div] outputs: [/encoder/5/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_6 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul [Mul] inputs: [/encoder/5/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_6_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Mul for ONNX node: /encoder/5/encoder/1/nonlin_attention/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul [Mul] outputs: [/encoder/5/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice [Slice] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Constant_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Slice for ONNX node: /encoder/5/encoder/1/nonlin_attention/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Slice_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice [Slice] outputs: [/encoder/5/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_7 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_1 [Mul] inputs: [/encoder/5/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_7_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Mul_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_1 [Mul] outputs: [/encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice_1 [Slice] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Slice_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice_1 [Slice] outputs: [/encoder/5/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_8 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_2 [Mul] inputs: [/encoder/5/encoder/1/nonlin_attention/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_8_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Mul_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_2 [Mul] outputs: [/encoder/5/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Slice_2 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice_2 [Slice] inputs: [/encoder/5/encoder/1/nonlin_attention/in_proj/Add_output_0 -> (-1, -1, 576)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Mul_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Slice_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Slice_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Slice_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Slice_2 [Slice] outputs: [/encoder/5/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh [Tanh] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/tanh/Tanh [Tanh] inputs: [/encoder/5/encoder/1/nonlin_attention/Slice_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh for ONNX node: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/tanh/Tanh [Tanh] outputs: [/encoder/5/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_9 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/tanh/Tanh_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/tanh/Tanh_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 192), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7474 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7474 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7474 [Constant] outputs: [onnx::Unsqueeze_8768 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8768 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8768 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7476 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7476 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7476 [Constant] outputs: [onnx::Unsqueeze_8770 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8770 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8770 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_10 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat [Concat] inputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_10_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Concat for ONNX node: /encoder/5/encoder/1/nonlin_attention/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Concat_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat [Concat] outputs: [/encoder/5/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape [Reshape] inputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_output_0 -> (-1, -1, 192, 1)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Reshape for ONNX node: /encoder/5/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape [Reshape] outputs: [/encoder/5/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Mul_3 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_3 [Mul] inputs: [/encoder/5/encoder/1/nonlin_attention/Slice_1_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Reshape_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Mul_3 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Mul_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_3 [Mul] outputs: [/encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_3 [Shape] inputs: [/encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape_3 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_3 [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_11 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_3 [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_3_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_11_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_11_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather_3 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_3 [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape_4 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_4 [Shape] inputs: [/encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape_4 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_4_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_4 [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_12 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather_4 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_4 [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_4_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_12_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_12_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather_4 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_4 [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Shape_5 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_5 [Shape] inputs: [/encoder/5/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Shape_5 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Shape_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Shape_5_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Shape_5 [Shape] outputs: [/encoder/5/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_13 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Gather_5 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Shape_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_5 [Gather] inputs: [/encoder/5/encoder/1/nonlin_attention/Shape_5_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_13_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_13_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Gather_5 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Gather_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Gather_5_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Gather_5 [Gather] outputs: [/encoder/5/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7491 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7491 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7491 [Constant] outputs: [onnx::Unsqueeze_8786 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8786 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8786 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7493 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7493 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7493 [Constant] outputs: [onnx::Unsqueeze_8788 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8788 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8788 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7495 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7495 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7495 [Constant] outputs: [onnx::Unsqueeze_8790 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8790 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_5_output_0 -> ()[INT32]], [onnx::Unsqueeze_8790 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_14 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat_1 [Concat] inputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_14_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Concat_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat_1 [Concat] outputs: [/encoder/5/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/1/nonlin_attention/Mul_3_output_0 -> (-1, -1, 192)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Concat_1_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Reshape_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Transpose [Transpose] inputs: [/encoder/5/encoder/1/nonlin_attention/Reshape_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Transpose for ONNX node: /encoder/5/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Transpose [Transpose] outputs: [/encoder/5/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Slice_output_0 -> (1, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Transpose_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/MatMul for ONNX node: /encoder/5/encoder/1/nonlin_attention/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/MatMul [MatMul] outputs: [/encoder/5/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/nonlin_attention/MatMul_output_0 -> (1, -1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Transpose_1 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7503 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7503 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7503 [Constant] outputs: [onnx::Unsqueeze_8799 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8799 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_3_output_0 -> ()[INT32]], [onnx::Unsqueeze_8799 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7505 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7505 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7505 [Constant] outputs: [onnx::Unsqueeze_8801 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8801 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] inputs: [/encoder/5/encoder/1/nonlin_attention/Gather_4_output_0 -> ()[INT32]], [onnx::Unsqueeze_8801 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7 [Unsqueeze] outputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Constant_15 [Constant] outputs: [/encoder/5/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Unsqueeze_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat_2 [Concat] inputs: [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_6_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Unsqueeze_7_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/nonlin_attention/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Constant_15_output_0 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Concat_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Concat_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Concat_2 [Concat] outputs: [/encoder/5/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Reshape_2 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape_2 [Reshape] inputs: [/encoder/5/encoder/1/nonlin_attention/Transpose_1_output_0 -> (-1, -1, 1, 192)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Concat_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Reshape_2 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Reshape_2 [Reshape] outputs: [/encoder/5/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/Mul_4 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Reshape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Slice_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_4 [Mul] inputs: [/encoder/5/encoder/1/nonlin_attention/Reshape_2_output_0 -> (-1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/Slice_2_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/Mul_4 for ONNX node: /encoder/5/encoder/1/nonlin_attention/Mul_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/Mul_4_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/Mul_4 [Mul] outputs: [/encoder/5/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/Mul_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9767 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/nonlin_attention/Mul_4_output_0 -> (-1, -1, 192)[FLOAT]], [onnx::MatMul_9767 -> (192, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9767 for ONNX node: onnx::MatMul_9767 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/nonlin_attention/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/nonlin_attention/out_proj/Add for ONNX node: /encoder/5/encoder/1/nonlin_attention/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/nonlin_attention/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/nonlin_attention/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/nonlin_attention/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_1 [Add] inputs: [/encoder/5/encoder/1/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/nonlin_attention/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_1 for ONNX node: /encoder/5/encoder/1/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_1 [Add] outputs: [/encoder/5/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape [Shape] inputs: [/encoder/5/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Shape for ONNX node: /encoder/5/encoder/1/self_attn1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape [Shape] outputs: [/encoder/5/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant [Constant] outputs: [/encoder/5/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather [Gather] inputs: [/encoder/5/encoder/1/self_attn1/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn1/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Constant_output_0 for ONNX node: /encoder/5/encoder/1/self_attn1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Gather for ONNX node: /encoder/5/encoder/1/self_attn1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather [Gather] outputs: [/encoder/5/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Shape_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_1 [Gather] inputs: [/encoder/5/encoder/1/self_attn1/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn1/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/self_attn1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Gather_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_1 [Gather] outputs: [/encoder/5/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_2 [Shape] inputs: [/encoder/5/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Shape_2 for ONNX node: /encoder/5/encoder/1/self_attn1/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_2 [Shape] outputs: [/encoder/5/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_2 [Gather] inputs: [/encoder/5/encoder/1/self_attn1/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn1/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/self_attn1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Gather_2 for ONNX node: /encoder/5/encoder/1/self_attn1/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_2 [Gather] outputs: [/encoder/5/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9768 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9768 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9768 for ONNX node: onnx::MatMul_9768 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/self_attn1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias -> (48)[FLOAT]], [/encoder/5/encoder/1/self_attn1/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/in_proj/Add for ONNX node: /encoder/5/encoder/1/self_attn1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7525 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7525 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7525 [Constant] outputs: [onnx::Unsqueeze_8824 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8824 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8824 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7527 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7527 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7527 [Constant] outputs: [onnx::Unsqueeze_8826 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8826 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8826 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7529 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7529 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7529 [Constant] outputs: [onnx::Unsqueeze_8828 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8828 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8828 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze_2 for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Concat [Concat] inputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn1/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn1/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/self_attn1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Concat for ONNX node: /encoder/5/encoder/1/self_attn1/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Concat_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Concat [Concat] outputs: [/encoder/5/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Reshape [Reshape] inputs: [/encoder/5/encoder/1/self_attn1/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/5/encoder/1/self_attn1/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Reshape for ONNX node: /encoder/5/encoder/1/self_attn1/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Reshape [Reshape] outputs: [/encoder/5/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Transpose [Transpose] inputs: [/encoder/5/encoder/1/self_attn1/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Transpose for ONNX node: /encoder/5/encoder/1/self_attn1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Transpose [Transpose] outputs: [/encoder/5/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_3 [Shape] inputs: [/encoder/5/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Shape_3 for ONNX node: /encoder/5/encoder/1/self_attn1/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Shape_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Shape_3 [Shape] outputs: [/encoder/5/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Gather_3 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_3 [Gather] inputs: [/encoder/5/encoder/1/self_attn1/Shape_3_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn1/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/self_attn1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Gather_3 for ONNX node: /encoder/5/encoder/1/self_attn1/Gather_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Gather_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Gather_3 [Gather] outputs: [/encoder/5/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/MatMul [MatMul] inputs: [/encoder/5/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn1/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/MatMul for ONNX node: /encoder/5/encoder/1/self_attn1/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/self_attn1/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Transpose_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Mul [Mul] inputs: [/encoder/5/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn1/Gather_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Mul for ONNX node: /encoder/5/encoder/1/self_attn1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Mul [Mul] outputs: [/encoder/5/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7541 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7541 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7541 [Constant] outputs: [onnx::Unsqueeze_8841 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8841 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8841 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze_3 for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7543 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7543 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7543 [Constant] outputs: [onnx::Unsqueeze_8843 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8843 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8843 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze_4 for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7545 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7545 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7545 [Constant] outputs: [onnx::Unsqueeze_8845 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8845 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_8845 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Unsqueeze_5 for ONNX node: /encoder/5/encoder/1/self_attn1/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Concat_1 [Concat] inputs: [/encoder/5/encoder/1/self_attn1/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn1/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn1/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Concat_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Concat_1 [Concat] outputs: [/encoder/5/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/1/self_attn1/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/5/encoder/1/self_attn1/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/Reshape_1 for ONNX node: /encoder/5/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9770 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/self_attn1/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9770 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9770 for ONNX node: onnx::MatMul_9770 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/self_attn1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/self_attn1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn1/out_proj/Add for ONNX node: /encoder/5/encoder/1/self_attn1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn1/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_2 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_2 [Add] inputs: [/encoder/5/encoder/1/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/self_attn1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_2 for ONNX node: /encoder/5/encoder/1/Add_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_2_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_2 [Add] outputs: [/encoder/5/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9771 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9771 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9771 for ONNX node: onnx::MatMul_9771 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/conv_module1/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias -> (512)[FLOAT]], [/encoder/5/encoder/1/conv_module1/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/in_proj/Add for ONNX node: /encoder/5/encoder/1/conv_module1/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Shape [Shape] inputs: [/encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Shape for ONNX node: /encoder/5/encoder/1/conv_module1/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Shape [Shape] outputs: [/encoder/5/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Gather [Gather] inputs: [/encoder/5/encoder/1/conv_module1/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Gather for ONNX node: /encoder/5/encoder/1/conv_module1/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Gather [Gather] outputs: [/encoder/5/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Add [Add] inputs: [/encoder/5/encoder/1/conv_module1/Gather_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Add for ONNX node: /encoder/5/encoder/1/conv_module1/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Add [Add] outputs: [/encoder/5/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Div [Div] inputs: [/encoder/5/encoder/1/conv_module1/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Div for ONNX node: /encoder/5/encoder/1/conv_module1/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Div_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Div [Div] outputs: [/encoder/5/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul [Mul] inputs: [/encoder/5/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Mul for ONNX node: /encoder/5/encoder/1/conv_module1/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul [Mul] outputs: [/encoder/5/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Slice [Slice] inputs: [/encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/1/conv_module1/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Slice for ONNX node: /encoder/5/encoder/1/conv_module1/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Slice_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Slice [Slice] outputs: [/encoder/5/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_5 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul_1 [Mul] inputs: [/encoder/5/encoder/1/conv_module1/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_5_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Mul_1 for ONNX node: /encoder/5/encoder/1/conv_module1/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul_1 [Mul] outputs: [/encoder/5/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Slice_1 [Slice] inputs: [/encoder/5/encoder/1/conv_module1/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/1/conv_module1/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module1/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Slice_1 for ONNX node: /encoder/5/encoder/1/conv_module1/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Slice_1 [Slice] outputs: [/encoder/5/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/5/encoder/1/conv_module1/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid for ONNX node: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul_2 [Mul] inputs: [/encoder/5/encoder/1/conv_module1/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Mul_2 for ONNX node: /encoder/5/encoder/1/conv_module1/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Mul_2 [Mul] outputs: [/encoder/5/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Transpose [Transpose] inputs: [/encoder/5/encoder/1/conv_module1/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Transpose for ONNX node: /encoder/5/encoder/1/conv_module1/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Transpose [Transpose] outputs: [/encoder/5/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Shape_1 for ONNX node: /encoder/5/encoder/1/conv_module1/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/1/conv_module1/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Expand for ONNX node: /encoder/5/encoder/1/conv_module1/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Expand_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Expand [Expand] outputs: [/encoder/5/encoder/1/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Cast [Cast] inputs: [/encoder/5/encoder/1/conv_module1/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Cast for ONNX node: /encoder/5/encoder/1/conv_module1/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Cast [Cast] outputs: [/encoder/5/encoder/1/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Constant_6 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Where [Where] inputs: [/encoder/5/encoder/1/conv_module1/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/5/encoder/1/conv_module1/Constant_6_output_0 -> ()[FLOAT]], [/encoder/5/encoder/1/conv_module1/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Constant_6_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Where for ONNX node: /encoder/5/encoder/1/conv_module1/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Where [Where] outputs: [/encoder/5/encoder/1/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv [Conv] inputs: [/encoder/5/encoder/1/conv_module1/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.5.encoder.layers.1.conv_module1.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv for ONNX node: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv [Conv] outputs: [/encoder/5/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/conv_module1/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/Transpose_1 for ONNX node: /encoder/5/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Sub for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Exp for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Add [Add] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Add for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Log [Log] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Log for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Log [Log] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Cast for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Equal for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Where [Where] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/5/encoder/1/conv_module1/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Where for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Where [Where] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/1/conv_module1/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Mul for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9772 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/conv_module1/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9772 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9772 for ONNX node: onnx::MatMul_9772 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module1/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module1/out_proj/Add_1 for ONNX node: /encoder/5/encoder/1/conv_module1/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module1/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module1/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_3 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module1/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_3 [Add] inputs: [/encoder/5/encoder/1/Add_2_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module1/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_3 for ONNX node: /encoder/5/encoder/1/Add_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_3_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_3 [Add] outputs: [/encoder/5/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9773 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9773 -> (256, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9773 for ONNX node: onnx::MatMul_9773 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias -> (768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/in_proj/MatMul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/in_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Sub for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Exp for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Add [Add] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Exp_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Log [Log] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Log for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Log [Log] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Log_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Cast for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Equal for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Where [Where] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Equal_output_0 -> (-1, -1, 768)[BOOL]], [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Cast_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Where for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Where [Where] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/1/feed_forward2/in_proj/Add_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Mul for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Where_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Mul_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_1_output_0 -> (-1, -1, 768)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9774 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Sub_2_output_0 -> (-1, -1, 768)[FLOAT]], [onnx::MatMul_9774 -> (768, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9774 for ONNX node: onnx::MatMul_9774 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1 for ONNX node: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward2/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_4 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_4 [Add] inputs: [/encoder/5/encoder/1/Add_3_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/feed_forward2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_4 for ONNX node: /encoder/5/encoder/1/Add_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_4_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_4 [Add] outputs: [/encoder/5/encoder/1/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass_mid/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Sub [Sub] inputs: [/encoder/5/encoder/1/Add_4_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass_mid/Sub for ONNX node: /encoder/5/encoder/1/bypass_mid/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass_mid/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Sub [Sub] outputs: [/encoder/5/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass_mid/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Mul [Mul] inputs: [/encoder/5/encoder/1/bypass_mid/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale for ONNX node: encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass_mid/Mul for ONNX node: /encoder/5/encoder/1/bypass_mid/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass_mid/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Mul [Mul] outputs: [/encoder/5/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass_mid/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Add [Add] inputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/bypass_mid/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass_mid/Add for ONNX node: /encoder/5/encoder/1/bypass_mid/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass_mid/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass_mid/Add [Add] outputs: [/encoder/5/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape [Shape] inputs: [/encoder/5/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Shape for ONNX node: /encoder/5/encoder/1/self_attn2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape [Shape] outputs: [/encoder/5/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant [Constant] outputs: [/encoder/5/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather [Gather] inputs: [/encoder/5/encoder/1/self_attn2/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn2/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Constant_output_0 for ONNX node: /encoder/5/encoder/1/self_attn2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Gather for ONNX node: /encoder/5/encoder/1/self_attn2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather [Gather] outputs: [/encoder/5/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Shape_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather_1 [Gather] inputs: [/encoder/5/encoder/1/self_attn2/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/self_attn2/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/self_attn2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Gather_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Gather_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather_1 [Gather] outputs: [/encoder/5/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9775 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9775 -> (256, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9775 for ONNX node: onnx::MatMul_9775 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/self_attn2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias -> (48)[FLOAT]], [/encoder/5/encoder/1/self_attn2/in_proj/MatMul_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/in_proj/Add for ONNX node: /encoder/5/encoder/1/self_attn2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7627 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7627 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7627 [Constant] outputs: [onnx::Unsqueeze_8933 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8933 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8933 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7629 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7629 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7629 [Constant] outputs: [onnx::Unsqueeze_8935 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8935 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8935 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7631 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7631 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7631 [Constant] outputs: [onnx::Unsqueeze_8937 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8937 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_8937 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze_2 for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Concat [Concat] inputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn2/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn2/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/self_attn2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Concat for ONNX node: /encoder/5/encoder/1/self_attn2/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Concat_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Concat [Concat] outputs: [/encoder/5/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Reshape [Reshape] inputs: [/encoder/5/encoder/1/self_attn2/in_proj/Add_output_0 -> (-1, -1, 48)[FLOAT]], [/encoder/5/encoder/1/self_attn2/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Reshape for ONNX node: /encoder/5/encoder/1/self_attn2/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Reshape_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Reshape [Reshape] outputs: [/encoder/5/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Transpose [Transpose] inputs: [/encoder/5/encoder/1/self_attn2/Reshape_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Transpose for ONNX node: /encoder/5/encoder/1/self_attn2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Transpose [Transpose] outputs: [/encoder/5/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape_2 [Shape] inputs: [/encoder/5/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Shape_2 for ONNX node: /encoder/5/encoder/1/self_attn2/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Shape_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Shape_2 [Shape] outputs: [/encoder/5/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather_2 [Gather] inputs: [/encoder/5/encoder/1/self_attn2/Shape_2_output_0 -> (4)[INT32]], [/encoder/5/encoder/1/self_attn2/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/self_attn2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Gather_2 for ONNX node: /encoder/5/encoder/1/self_attn2/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Gather_2_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Gather_2 [Gather] outputs: [/encoder/5/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn_weights/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/MatMul [MatMul] inputs: [/encoder/5/encoder/1/self_attn_weights/Softmax_output_0 -> (4, -1, -1, -1)[FLOAT]], [/encoder/5/encoder/1/self_attn2/Transpose_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/MatMul for ONNX node: /encoder/5/encoder/1/self_attn2/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/self_attn2/MatMul_output_0 -> (4, -1, -1, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Transpose_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn1/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Mul [Mul] inputs: [/encoder/5/encoder/1/self_attn1/Gather_2_output_0 -> ()[INT32]], [/encoder/5/encoder/1/self_attn2/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Mul for ONNX node: /encoder/5/encoder/1/self_attn2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Mul [Mul] outputs: [/encoder/5/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7643 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7643 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7643 [Constant] outputs: [onnx::Unsqueeze_8950 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8950 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn2/Gather_output_0 -> ()[INT32]], [onnx::Unsqueeze_8950 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze_3 for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7645 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7645 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7645 [Constant] outputs: [onnx::Unsqueeze_8952 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8952 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn2/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_8952 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze_4 for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7647 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7647 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7647 [Constant] outputs: [onnx::Unsqueeze_8954 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_8954 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/encoder/1/self_attn2/Mul_output_0 -> ()[INT32]], [onnx::Unsqueeze_8954 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Unsqueeze_5 for ONNX node: /encoder/5/encoder/1/self_attn2/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Concat_1 [Concat] inputs: [/encoder/5/encoder/1/self_attn2/Unsqueeze_3_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn2/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/self_attn2/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Concat_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Concat_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Concat_1 [Concat] outputs: [/encoder/5/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Reshape_1 [Reshape] inputs: [/encoder/5/encoder/1/self_attn2/Transpose_1_output_0 -> (-1, -1, 4, 12)[FLOAT]], [/encoder/5/encoder/1/self_attn2/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/Reshape_1 for ONNX node: /encoder/5/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/Reshape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/Reshape_1 [Reshape] outputs: [/encoder/5/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9777 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/self_attn2/Reshape_1_output_0 -> (-1, -1, 48)[FLOAT]], [onnx::MatMul_9777 -> (48, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9777 for ONNX node: onnx::MatMul_9777 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/self_attn2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/self_attn2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/out_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/self_attn2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/self_attn2/out_proj/Add for ONNX node: /encoder/5/encoder/1/self_attn2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/self_attn2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/self_attn2/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_5 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass_mid/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/self_attn2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_5 [Add] inputs: [/encoder/5/encoder/1/bypass_mid/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/self_attn2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_5 for ONNX node: /encoder/5/encoder/1/Add_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_5_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_5 [Add] outputs: [/encoder/5/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9778 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9778 -> (256, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9778 for ONNX node: onnx::MatMul_9778 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/conv_module2/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias -> (512)[FLOAT]], [/encoder/5/encoder/1/conv_module2/in_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/in_proj/Add for ONNX node: /encoder/5/encoder/1/conv_module2/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Shape [Shape] inputs: [/encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Shape for ONNX node: /encoder/5/encoder/1/conv_module2/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Shape_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Shape [Shape] outputs: [/encoder/5/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Gather [Gather] inputs: [/encoder/5/encoder/1/conv_module2/Shape_output_0 -> (3)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Gather for ONNX node: /encoder/5/encoder/1/conv_module2/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Gather_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Gather [Gather] outputs: [/encoder/5/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Add [Add] inputs: [/encoder/5/encoder/1/conv_module2/Gather_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Add for ONNX node: /encoder/5/encoder/1/conv_module2/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Add [Add] outputs: [/encoder/5/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Div [Div] inputs: [/encoder/5/encoder/1/conv_module2/Add_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Div for ONNX node: /encoder/5/encoder/1/conv_module2/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Div_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Div [Div] outputs: [/encoder/5/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul [Mul] inputs: [/encoder/5/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Mul for ONNX node: /encoder/5/encoder/1/conv_module2/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul [Mul] outputs: [/encoder/5/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Slice [Slice] inputs: [/encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/1/conv_module2/Constant_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Slice for ONNX node: /encoder/5/encoder/1/conv_module2/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Slice_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Slice [Slice] outputs: [/encoder/5/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_5 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul_1 [Mul] inputs: [/encoder/5/encoder/1/conv_module2/Div_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_5_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Mul_1 for ONNX node: /encoder/5/encoder/1/conv_module2/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul_1 [Mul] outputs: [/encoder/5/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Slice_1 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Slice_1 [Slice] inputs: [/encoder/5/encoder/1/conv_module2/in_proj/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/5/encoder/1/conv_module2/Mul_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Mul_1_output_0 -> (1)[INT32]], [/encoder/5/encoder/1/conv_module2/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Slice_1 for ONNX node: /encoder/5/encoder/1/conv_module2/Slice_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Slice_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Slice_1 [Slice] outputs: [/encoder/5/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Slice_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] inputs: [/encoder/5/encoder/1/conv_module2/Slice_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid for ONNX node: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid [Sigmoid] outputs: [/encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul_2 [Mul] inputs: [/encoder/5/encoder/1/conv_module2/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/sigmoid/Sigmoid_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Mul_2 for ONNX node: /encoder/5/encoder/1/conv_module2/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Mul_2_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Mul_2 [Mul] outputs: [/encoder/5/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Transpose [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Transpose [Transpose] inputs: [/encoder/5/encoder/1/conv_module2/Mul_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Transpose for ONNX node: /encoder/5/encoder/1/conv_module2/Transpose [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Transpose_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Transpose [Transpose] outputs: [/encoder/5/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Shape_1 for ONNX node: /encoder/5/encoder/1/conv_module2/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Shape_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Shape_1 [Shape] outputs: [/encoder/5/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Expand [Expand] inputs: [/encoder/1/encoder/0/self_attn_weights/Unsqueeze_15_output_0 -> (-1, 1, -1)[BOOL]], [/encoder/5/encoder/1/conv_module2/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Expand for ONNX node: /encoder/5/encoder/1/conv_module2/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Expand_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Expand [Expand] outputs: [/encoder/5/encoder/1/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Cast [Cast] inputs: [/encoder/5/encoder/1/conv_module2/Expand_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: bool [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Cast for ONNX node: /encoder/5/encoder/1/conv_module2/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Cast [Cast] outputs: [/encoder/5/encoder/1/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Constant_6 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Transpose_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Where [Where] inputs: [/encoder/5/encoder/1/conv_module2/Cast_output_0 -> (-1, 256, -1)[BOOL]], [/encoder/5/encoder/1/conv_module2/Constant_6_output_0 -> ()[FLOAT]], [/encoder/5/encoder/1/conv_module2/Transpose_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Constant_6_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Where for ONNX node: /encoder/5/encoder/1/conv_module2/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Where [Where] outputs: [/encoder/5/encoder/1/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv [Conv] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.weight [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv [Conv] inputs: [/encoder/5/encoder/1/conv_module2/Where_output_0 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.weight -> (256, 1, 31)[FLOAT]], [encoder.encoders.5.encoder.layers.1.conv_module2.depthwise_conv.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv for ONNX node: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [07/20/2023-07:25:31] [V] [TRT] Using kernel: (31, 1), strides: (1, 1), prepadding: (15, 0), postpadding: (15, 0), dilations: (1, 1), numOutputs: 256 [07/20/2023-07:25:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv [Conv] outputs: [/encoder/5/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Transpose_1 [Transpose] inputs: [/encoder/5/encoder/1/conv_module2/depthwise_conv/Conv_output_0 -> (-1, 256, -1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/Transpose_1 for ONNX node: /encoder/5/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/Transpose_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/Transpose_1 [Transpose] outputs: [/encoder/5/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Sub for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Exp for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Add [Add] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Exp_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Add for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Log [Log] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Log for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Log [Log] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Log_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Cast for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Equal for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Where [Where] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Equal_output_0 -> (-1, -1, 256)[BOOL]], [/encoder/5/encoder/1/conv_module2/out_proj/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Cast_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Where for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Where [Where] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/1/conv_module2/Transpose_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Mul for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Where_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9779 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/conv_module2/out_proj/Sub_2_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9779 -> (256, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9779 for ONNX node: onnx::MatMul_9779 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/conv_module2/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/conv_module2/out_proj/Add_1 for ONNX node: /encoder/5/encoder/1/conv_module2/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/conv_module2/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/conv_module2/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_6 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/conv_module2/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_6 [Add] inputs: [/encoder/5/encoder/1/Add_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/conv_module2/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_6 for ONNX node: /encoder/5/encoder/1/Add_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_6_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_6 [Add] outputs: [/encoder/5/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9780 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/in_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [onnx::MatMul_9780 -> (256, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9780 for ONNX node: onnx::MatMul_9780 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/in_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/in_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/in_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/in_proj/Add [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias -> (960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/in_proj/MatMul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/in_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward3/in_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/in_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant [Constant] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub [Sub] inputs: [/encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Sub for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub [Sub] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Exp [Exp] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Exp for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Exp [Exp] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Add [Add] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Exp_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Add for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Add [Add] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Log [Log] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Log [Log] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Log for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Log [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Log_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Log [Log] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Log_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Cast [Cast] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Log_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: float32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Cast for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Cast [Cast] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2 [Constant] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Equal [Equal] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Equal for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Equal_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Equal [Equal] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Where [Where] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Equal_output_0 -> (-1, -1, 960)[BOOL]], [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Cast_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Where for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Where_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Where [Where] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3 [Constant] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Mul [Mul] inputs: [/encoder/5/encoder/1/feed_forward3/in_proj/Add_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Mul for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Mul [Mul] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Where_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Mul_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1 [Sub] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4 [Constant] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_1_output_0 -> (-1, -1, 960)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2 [Sub] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9781 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/MatMul [MatMul] inputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Sub_2_output_0 -> (-1, -1, 960)[FLOAT]], [onnx::MatMul_9781 -> (960, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9781 for ONNX node: onnx::MatMul_9781 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/MatMul [MatMul] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Add_1 [Add] inputs: [encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias -> (256)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/MatMul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias for ONNX node: encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1 for ONNX node: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1_output_0 for ONNX tensor: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/feed_forward3/out_proj/Add_1 [Add] outputs: [/encoder/5/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/Add_7 [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/feed_forward3/out_proj/Add_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_7 [Add] inputs: [/encoder/5/encoder/1/Add_6_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/feed_forward3/out_proj/Add_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/Add_7 for ONNX node: /encoder/5/encoder/1/Add_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/Add_7_output_0 for ONNX tensor: /encoder/5/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/Add_7 [Add] outputs: [/encoder/5/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Sub [Sub] inputs: [/encoder/5/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.1.norm.bias -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.norm.bias for ONNX node: encoder.encoders.5.encoder.layers.1.norm.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Sub for ONNX node: /encoder/5/encoder/1/norm/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Sub [Sub] outputs: [/encoder/5/encoder/1/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Constant [Constant] outputs: [/encoder/5/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Pow [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Pow [Pow] inputs: [/encoder/5/encoder/1/norm/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/norm/Constant_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Constant_output_0 for ONNX node: /encoder/5/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Pow for ONNX node: /encoder/5/encoder/1/norm/Pow [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Pow_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Pow [Pow] outputs: [/encoder/5/encoder/1/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/ReduceMean [ReduceMean] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Pow_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/ReduceMean [ReduceMean] inputs: [/encoder/5/encoder/1/norm/Pow_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/ReduceMean for ONNX node: /encoder/5/encoder/1/norm/ReduceMean [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/ReduceMean_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/ReduceMean [ReduceMean] outputs: [/encoder/5/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Constant_1 [Constant] outputs: [/encoder/5/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Pow_1 [Pow] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/ReduceMean_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Pow_1 [Pow] inputs: [/encoder/5/encoder/1/norm/ReduceMean_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/5/encoder/1/norm/Constant_1_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Constant_1_output_0 for ONNX node: /encoder/5/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Pow_1 for ONNX node: /encoder/5/encoder/1/norm/Pow_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Pow_1_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Pow_1 [Pow] outputs: [/encoder/5/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Exp [Exp] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Exp [Exp] inputs: [encoder.encoders.5.encoder.layers.1.norm.log_scale -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.norm.log_scale for ONNX node: encoder.encoders.5.encoder.layers.1.norm.log_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Exp for ONNX node: /encoder/5/encoder/1/norm/Exp [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Exp_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Exp [Exp] outputs: [/encoder/5/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Pow_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Exp_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Mul [Mul] inputs: [/encoder/5/encoder/1/norm/Pow_1_output_0 -> (-1, -1, 1)[FLOAT]], [/encoder/5/encoder/1/norm/Exp_output_0 -> ()[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Mul for ONNX node: /encoder/5/encoder/1/norm/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Mul [Mul] outputs: [/encoder/5/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/norm/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/Add_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Mul_1 [Mul] inputs: [/encoder/5/encoder/1/Add_7_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/norm/Mul_output_0 -> (-1, -1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/norm/Mul_1 for ONNX node: /encoder/5/encoder/1/norm/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/norm/Mul_1_output_0 for ONNX tensor: /encoder/5/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/norm/Mul_1 [Mul] outputs: [/encoder/5/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/norm/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Sub [Sub] inputs: [/encoder/5/encoder/1/norm/Mul_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass/Sub for ONNX node: /encoder/5/encoder/1/bypass/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass/Sub_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Sub [Sub] outputs: [/encoder/5/encoder/1/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Mul [Mul] inputs: [/encoder/5/encoder/1/bypass/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.encoder.layers.1.bypass.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.encoder.layers.1.bypass.bypass_scale for ONNX node: encoder.encoders.5.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass/Mul for ONNX node: /encoder/5/encoder/1/bypass/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass/Mul_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Mul [Mul] outputs: [/encoder/5/encoder/1/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/encoder/1/bypass/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/0/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Add [Add] inputs: [/encoder/5/encoder/0/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/encoder/1/bypass/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/encoder/1/bypass/Add for ONNX node: /encoder/5/encoder/1/bypass/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/encoder/1/bypass/Add_output_0 for ONNX tensor: /encoder/5/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/encoder/1/bypass/Add [Add] outputs: [/encoder/5/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape [Shape] inputs: [/encoder/5/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Shape for ONNX node: /encoder/5/upsample/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Shape_output_0 for ONNX tensor: /encoder/5/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape [Shape] outputs: [/encoder/5/upsample/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant [Constant] outputs: [/encoder/5/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather [Gather] inputs: [/encoder/5/upsample/Shape_output_0 -> (3)[INT32]], [/encoder/5/upsample/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_output_0 for ONNX node: /encoder/5/upsample/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Gather for ONNX node: /encoder/5/upsample/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Gather_output_0 for ONNX tensor: /encoder/5/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather [Gather] outputs: [/encoder/5/upsample/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_1 [Shape] inputs: [/encoder/5/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Shape_1 for ONNX node: /encoder/5/upsample/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Shape_1_output_0 for ONNX tensor: /encoder/5/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_1 [Shape] outputs: [/encoder/5/upsample/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_1 [Constant] outputs: [/encoder/5/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather_1 [Gather] inputs: [/encoder/5/upsample/Shape_1_output_0 -> (3)[INT32]], [/encoder/5/upsample/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_1_output_0 for ONNX node: /encoder/5/upsample/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Gather_1 for ONNX node: /encoder/5/upsample/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Gather_1_output_0 for ONNX tensor: /encoder/5/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather_1 [Gather] outputs: [/encoder/5/upsample/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_2 [Shape] inputs: [/encoder/5/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Shape_2 for ONNX node: /encoder/5/upsample/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Shape_2_output_0 for ONNX tensor: /encoder/5/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_2 [Shape] outputs: [/encoder/5/upsample/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_2 [Constant] outputs: [/encoder/5/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather_2 [Gather] inputs: [/encoder/5/upsample/Shape_2_output_0 -> (3)[INT32]], [/encoder/5/upsample/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_2_output_0 for ONNX node: /encoder/5/upsample/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Gather_2 for ONNX node: /encoder/5/upsample/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Gather_2_output_0 for ONNX tensor: /encoder/5/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Gather_2 [Gather] outputs: [/encoder/5/upsample/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_3 [Constant] outputs: [/encoder/5/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/encoder/1/bypass/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze [Unsqueeze] inputs: [/encoder/5/encoder/1/bypass/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/upsample/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (_, _, 256), unsqueezing to: (_, _, _, _) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze for ONNX node: /encoder/5/upsample/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_4 [Constant] outputs: [/encoder/5/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/5/upsample/Gather_output_0 -> ()[INT32]], [/encoder/5/upsample/Constant_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_1 for ONNX node: /encoder/5/upsample/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_1_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_5 [Constant] outputs: [/encoder/5/upsample/Constant_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_6 [Constant] outputs: [/encoder/5/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/5/upsample/Gather_1_output_0 -> ()[INT32]], [/encoder/5/upsample/Constant_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_2 for ONNX node: /encoder/5/upsample/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_2_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_7 [Constant] outputs: [/encoder/5/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/5/upsample/Gather_2_output_0 -> ()[INT32]], [/encoder/5/upsample/Constant_7_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_3 for ONNX node: /encoder/5/upsample/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_3_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Concat [Concat] inputs: [/encoder/5/upsample/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/5/upsample/Constant_5_output_0 -> (1)[INT32]], [/encoder/5/upsample/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/5/upsample/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_5_output_0 for ONNX node: /encoder/5/upsample/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Concat for ONNX node: /encoder/5/upsample/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Concat_output_0 for ONNX tensor: /encoder/5/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Concat [Concat] outputs: [/encoder/5/upsample/Concat_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_8 [Constant] outputs: [/encoder/5/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Reshape [Reshape] inputs: [/encoder/5/upsample/Concat_output_0 -> (4)[INT32]], [/encoder/5/upsample/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Reshape for ONNX node: /encoder/5/upsample/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Reshape_output_0 for ONNX tensor: /encoder/5/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Reshape [Reshape] outputs: [/encoder/5/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_3 [Shape] inputs: [/encoder/5/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Shape_3 for ONNX node: /encoder/5/upsample/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Shape_3_output_0 for ONNX tensor: /encoder/5/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Shape_3 [Shape] outputs: [/encoder/5/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/ConstantOfShape [ConstantOfShape] inputs: [/encoder/5/upsample/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/ConstantOfShape_output_0 for ONNX tensor: /encoder/5/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/ConstantOfShape [ConstantOfShape] outputs: [/encoder/5/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_9 [Constant] outputs: [/encoder/5/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Mul [Mul] inputs: [/encoder/5/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/5/upsample/Constant_9_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_9_output_0 for ONNX node: /encoder/5/upsample/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Mul for ONNX node: /encoder/5/upsample/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Mul_output_0 for ONNX tensor: /encoder/5/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Mul [Mul] outputs: [/encoder/5/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Equal [Equal] inputs: [/encoder/5/upsample/Reshape_output_0 -> (4)[INT32]], [/encoder/5/upsample/Mul_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Equal for ONNX node: /encoder/5/upsample/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Equal_output_0 for ONNX tensor: /encoder/5/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Equal [Equal] outputs: [/encoder/5/upsample/Equal_output_0 -> (4)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Where [Where] inputs: [/encoder/5/upsample/Equal_output_0 -> (4)[BOOL]], [/encoder/5/upsample/ConstantOfShape_output_0 -> (4)[INT32]], [/encoder/5/upsample/Reshape_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Where for ONNX node: /encoder/5/upsample/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Where_output_0 for ONNX tensor: /encoder/5/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Where [Where] outputs: [/encoder/5/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Expand [Expand] inputs: [/encoder/5/upsample/Unsqueeze_output_0 -> (-1, 1, -1, 256)[FLOAT]], [/encoder/5/upsample/Where_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Expand for ONNX node: /encoder/5/upsample/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Expand_output_0 for ONNX tensor: /encoder/5/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Expand [Expand] outputs: [/encoder/5/upsample/Expand_output_0 -> (-1, 2, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Constant_10 [Constant] outputs: [/encoder/5/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Mul_1 [Mul] inputs: [/encoder/5/upsample/Gather_output_0 -> ()[INT32]], [/encoder/5/upsample/Constant_10_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Constant_10_output_0 for ONNX node: /encoder/5/upsample/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Mul_1 for ONNX node: /encoder/5/upsample/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Mul_1_output_0 for ONNX tensor: /encoder/5/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Mul_1 [Mul] outputs: [/encoder/5/upsample/Mul_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7760 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7760 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7760 [Constant] outputs: [onnx::Unsqueeze_9073 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9073 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/5/upsample/Mul_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_9073 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_4 for ONNX node: /encoder/5/upsample/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_4_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7762 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7762 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7762 [Constant] outputs: [onnx::Unsqueeze_9075 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9075 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/5/upsample/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_9075 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_5 for ONNX node: /encoder/5/upsample/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_5_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7764 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7764 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7764 [Constant] outputs: [onnx::Unsqueeze_9077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9077 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/5/upsample/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_9077 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Unsqueeze_6 for ONNX node: /encoder/5/upsample/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Unsqueeze_6_output_0 for ONNX tensor: /encoder/5/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/5/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Concat_1 [Concat] inputs: [/encoder/5/upsample/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/5/upsample/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/5/upsample/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Concat_1 for ONNX node: /encoder/5/upsample/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Concat_1_output_0 for ONNX tensor: /encoder/5/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Concat_1 [Concat] outputs: [/encoder/5/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/upsample/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Reshape_1 [Reshape] inputs: [/encoder/5/upsample/Expand_output_0 -> (-1, 2, -1, 256)[FLOAT]], [/encoder/5/upsample/Concat_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/upsample/Reshape_1 for ONNX node: /encoder/5/upsample/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/upsample/Reshape_1_output_0 for ONNX tensor: /encoder/5/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/upsample/Reshape_1 [Reshape] outputs: [/encoder/5/upsample/Reshape_1_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant [Constant] outputs: [/encoder/5/Constant_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_1 [Constant] outputs: [/encoder/5/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/downsample/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Unsqueeze [Unsqueeze] inputs: [/encoder/5/downsample/Gather_output_0 -> ()[INT32]], [/encoder/5/Constant_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/Unsqueeze for ONNX node: /encoder/5/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/Unsqueeze_output_0 for ONNX tensor: /encoder/5/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Unsqueeze [Unsqueeze] outputs: [/encoder/5/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_2 [Constant] outputs: [/encoder/5/Constant_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Constant_3 [Constant] outputs: [/encoder/5/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/upsample/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Slice [Slice] inputs: [/encoder/5/upsample/Reshape_1_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/Constant_output_0 -> (1)[INT32]], [/encoder/5/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/5/Constant_2_output_0 -> (1)[INT32]], [/encoder/5/Constant_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/Slice for ONNX node: /encoder/5/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/Slice_output_0 for ONNX tensor: /encoder/5/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/Slice [Slice] outputs: [/encoder/5/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/out_combiner/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Sub [Sub] inputs: [/encoder/5/Slice_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/out_combiner/Sub for ONNX node: /encoder/5/out_combiner/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/out_combiner/Sub_output_0 for ONNX tensor: /encoder/5/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Sub [Sub] outputs: [/encoder/5/out_combiner/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/out_combiner/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/out_combiner/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder.encoders.5.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Mul [Mul] inputs: [/encoder/5/out_combiner/Sub_output_0 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.out_combiner.bypass_scale -> (256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder.encoders.5.out_combiner.bypass_scale for ONNX node: encoder.encoders.5.out_combiner.bypass_scale [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/out_combiner/Mul for ONNX node: /encoder/5/out_combiner/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/out_combiner/Mul_output_0 for ONNX tensor: /encoder/5/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Mul [Mul] outputs: [/encoder/5/out_combiner/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/5/out_combiner/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/out_combiner/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Add [Add] inputs: [/encoder/Slice_5_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/5/out_combiner/Mul_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/5/out_combiner/Add for ONNX node: /encoder/5/out_combiner/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/5/out_combiner/Add_output_0 for ONNX tensor: /encoder/5/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/5/out_combiner/Add [Add] outputs: [/encoder/5/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_36 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_36 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_36 [Constant] outputs: [/encoder/Constant_36_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_37 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_37 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_37 [Constant] outputs: [/encoder/Constant_37_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_38 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_38 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_38 [Constant] outputs: [/encoder/Constant_38_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_39 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_39 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_39 [Constant] outputs: [/encoder/Constant_39_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_6 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/4/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_37_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_38_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_36_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_39_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_6 [Slice] inputs: [/encoder/4/out_combiner/Add_output_0 -> (-1, -1, 384)[FLOAT]], [/encoder/Constant_37_output_0 -> (1)[INT32]], [/encoder/Constant_38_output_0 -> (1)[INT32]], [/encoder/Constant_36_output_0 -> (1)[INT32]], [/encoder/Constant_39_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_6 for ONNX node: /encoder/Slice_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_6_output_0 for ONNX tensor: /encoder/Slice_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_6 [Slice] outputs: [/encoder/Slice_6_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_40 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_40 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_40 [Constant] outputs: [/encoder/Constant_40_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_41 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_41 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_41 [Constant] outputs: [/encoder/Constant_41_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_42 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_42 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_42 [Constant] outputs: [/encoder/Constant_42_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_43 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_43 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_43 [Constant] outputs: [/encoder/Constant_43_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Slice_7 [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/3/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_41_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_42_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_40_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_43_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_7 [Slice] inputs: [/encoder/3/out_combiner/Add_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/Constant_41_output_0 -> (1)[INT32]], [/encoder/Constant_42_output_0 -> (1)[INT32]], [/encoder/Constant_40_output_0 -> (1)[INT32]], [/encoder/Constant_43_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Slice_7 for ONNX node: /encoder/Slice_7 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Slice_7_output_0 for ONNX tensor: /encoder/Slice_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Slice_7 [Slice] outputs: [/encoder/Slice_7_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Concat_6 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/5/out_combiner/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Slice_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_6 [Concat] inputs: [/encoder/5/out_combiner/Add_output_0 -> (-1, -1, 256)[FLOAT]], [/encoder/Slice_6_output_0 -> (-1, -1, 128)[FLOAT]], [/encoder/Slice_7_output_0 -> (-1, -1, 128)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Concat_6 for ONNX node: /encoder/Concat_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Concat_6_output_0 for ONNX tensor: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Concat_6 [Concat] outputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Shape [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape [Shape] inputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Shape for ONNX node: /encoder/downsample_output/Shape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Shape_output_0 for ONNX tensor: /encoder/downsample_output/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape [Shape] outputs: [/encoder/downsample_output/Shape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant [Constant] outputs: [/encoder/downsample_output/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Gather [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Shape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather [Gather] inputs: [/encoder/downsample_output/Shape_output_0 -> (3)[INT32]], [/encoder/downsample_output/Constant_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_output_0 for ONNX node: /encoder/downsample_output/Constant_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Gather for ONNX node: /encoder/downsample_output/Gather [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Gather_output_0 for ONNX tensor: /encoder/downsample_output/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather [Gather] outputs: [/encoder/downsample_output/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Shape_1 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_1 [Shape] inputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Shape_1 for ONNX node: /encoder/downsample_output/Shape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Shape_1_output_0 for ONNX tensor: /encoder/downsample_output/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_1 [Shape] outputs: [/encoder/downsample_output/Shape_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_1 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_1 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_1 [Constant] outputs: [/encoder/downsample_output/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Gather_1 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Shape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather_1 [Gather] inputs: [/encoder/downsample_output/Shape_1_output_0 -> (3)[INT32]], [/encoder/downsample_output/Constant_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_1_output_0 for ONNX node: /encoder/downsample_output/Constant_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Gather_1 for ONNX node: /encoder/downsample_output/Gather_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Gather_1_output_0 for ONNX tensor: /encoder/downsample_output/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather_1 [Gather] outputs: [/encoder/downsample_output/Gather_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Shape_2 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_2 [Shape] inputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Shape_2 for ONNX node: /encoder/downsample_output/Shape_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Shape_2_output_0 for ONNX tensor: /encoder/downsample_output/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_2 [Shape] outputs: [/encoder/downsample_output/Shape_2_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_2 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_2 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_2 [Constant] outputs: [/encoder/downsample_output/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Gather_2 [Gather] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Shape_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather_2 [Gather] inputs: [/encoder/downsample_output/Shape_2_output_0 -> (3)[INT32]], [/encoder/downsample_output/Constant_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_2_output_0 for ONNX node: /encoder/downsample_output/Constant_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Using Gather axis: 0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Gather_2 for ONNX node: /encoder/downsample_output/Gather_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Gather_2_output_0 for ONNX tensor: /encoder/downsample_output/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Gather_2 [Gather] outputs: [/encoder/downsample_output/Gather_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_3 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_3 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_3 [Constant] outputs: [/encoder/downsample_output/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Add [Add] inputs: [/encoder/downsample_output/Gather_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_3_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_3_output_0 for ONNX node: /encoder/downsample_output/Constant_3_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Add for ONNX node: /encoder/downsample_output/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Add_output_0 for ONNX tensor: /encoder/downsample_output/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Add [Add] outputs: [/encoder/downsample_output/Add_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_4 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_4 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_4 [Constant] outputs: [/encoder/downsample_output/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Sub [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub [Sub] inputs: [/encoder/downsample_output/Add_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_4_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_4_output_0 for ONNX node: /encoder/downsample_output/Constant_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Sub for ONNX node: /encoder/downsample_output/Sub [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Sub_output_0 for ONNX tensor: /encoder/downsample_output/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub [Sub] outputs: [/encoder/downsample_output/Sub_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_5 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_5 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_5 [Constant] outputs: [/encoder/downsample_output/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Sub_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Div [Div] inputs: [/encoder/downsample_output/Sub_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_5_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_5_output_0 for ONNX node: /encoder/downsample_output/Constant_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Div for ONNX node: /encoder/downsample_output/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Div_output_0 for ONNX tensor: /encoder/downsample_output/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Div [Div] outputs: [/encoder/downsample_output/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Cast [Cast] inputs: [/encoder/downsample_output/Div_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Cast for ONNX node: /encoder/downsample_output/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Cast_output_0 for ONNX tensor: /encoder/downsample_output/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Cast [Cast] outputs: [/encoder/downsample_output/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Cast_1 [Cast] inputs: [/encoder/downsample_output/Cast_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Cast_1 for ONNX node: /encoder/downsample_output/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Cast_1_output_0 for ONNX tensor: /encoder/downsample_output/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Cast_1 [Cast] outputs: [/encoder/downsample_output/Cast_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_6 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_6 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_6 [Constant] outputs: [/encoder/downsample_output/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Mul [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul [Mul] inputs: [/encoder/downsample_output/Cast_1_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_6_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_6_output_0 for ONNX node: /encoder/downsample_output/Constant_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Mul for ONNX node: /encoder/downsample_output/Mul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Mul_output_0 for ONNX tensor: /encoder/downsample_output/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul [Mul] outputs: [/encoder/downsample_output/Mul_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Sub_1 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Mul_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub_1 [Sub] inputs: [/encoder/downsample_output/Mul_output_0 -> ()[INT32]], [/encoder/downsample_output/Gather_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Sub_1 for ONNX node: /encoder/downsample_output/Sub_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Sub_1_output_0 for ONNX tensor: /encoder/downsample_output/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub_1 [Sub] outputs: [/encoder/downsample_output/Sub_1_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_7 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_7 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_7 [Constant] outputs: [/encoder/downsample_output/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Sub_2 [Sub] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub_2 [Sub] inputs: [/encoder/downsample_output/Gather_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_7_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_7_output_0 for ONNX node: /encoder/downsample_output/Constant_7_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Sub_2 for ONNX node: /encoder/downsample_output/Sub_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Sub_2_output_0 for ONNX tensor: /encoder/downsample_output/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Sub_2 [Sub] outputs: [/encoder/downsample_output/Sub_2_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_8 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_8 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_8 [Constant] outputs: [/encoder/downsample_output/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Sub_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_8_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze [Unsqueeze] inputs: [/encoder/downsample_output/Sub_2_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_8_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze for ONNX node: /encoder/downsample_output/Unsqueeze [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_9 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_9 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_9 [Constant] outputs: [/encoder/downsample_output/Constant_9_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_10 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_10 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_10 [Constant] outputs: [/encoder/downsample_output/Constant_10_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_11 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_11 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_11 [Constant] outputs: [/encoder/downsample_output/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Slice [Slice] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_9_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_10_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_11_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Slice [Slice] inputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/downsample_output/Unsqueeze_output_0 -> (1)[INT32]], [/encoder/downsample_output/Constant_9_output_0 -> (1)[INT32]], [/encoder/downsample_output/Constant_10_output_0 -> (1)[INT32]], [/encoder/downsample_output/Constant_11_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Slice for ONNX node: /encoder/downsample_output/Slice [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Slice_output_0 for ONNX tensor: /encoder/downsample_output/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Slice [Slice] outputs: [/encoder/downsample_output/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_12 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_12 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_12 [Constant] outputs: [/encoder/downsample_output/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_1 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Sub_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_12_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_1 [Unsqueeze] inputs: [/encoder/downsample_output/Sub_1_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_12_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_1 for ONNX node: /encoder/downsample_output/Unsqueeze_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_1_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_1 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_1_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_13 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_13 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_13 [Constant] outputs: [/encoder/downsample_output/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_2 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_13_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_2 [Unsqueeze] inputs: [/encoder/downsample_output/Gather_1_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_13_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_2 for ONNX node: /encoder/downsample_output/Unsqueeze_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_2_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_2 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_2_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_14 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_14 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_14 [Constant] outputs: [/encoder/downsample_output/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_3 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_14_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_3 [Unsqueeze] inputs: [/encoder/downsample_output/Gather_2_output_0 -> ()[INT32]], [/encoder/downsample_output/Constant_14_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_3 for ONNX node: /encoder/downsample_output/Unsqueeze_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_3_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_3 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Concat [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat [Concat] inputs: [/encoder/downsample_output/Unsqueeze_1_output_0 -> (1)[INT32]], [/encoder/downsample_output/Unsqueeze_2_output_0 -> (1)[INT32]], [/encoder/downsample_output/Unsqueeze_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Concat for ONNX node: /encoder/downsample_output/Concat [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Concat_output_0 for ONNX tensor: /encoder/downsample_output/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat [Concat] outputs: [/encoder/downsample_output/Concat_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_15 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_15 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_15 [Constant] outputs: [/encoder/downsample_output/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Reshape [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Concat_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_15_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Reshape [Reshape] inputs: [/encoder/downsample_output/Concat_output_0 -> (3)[INT32]], [/encoder/downsample_output/Constant_15_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Reshape for ONNX node: /encoder/downsample_output/Reshape [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Reshape_output_0 for ONNX tensor: /encoder/downsample_output/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Reshape [Reshape] outputs: [/encoder/downsample_output/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Shape_3 [Shape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_3 [Shape] inputs: [/encoder/downsample_output/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Shape_3 for ONNX node: /encoder/downsample_output/Shape_3 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Shape_3_output_0 for ONNX tensor: /encoder/downsample_output/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Shape_3 [Shape] outputs: [/encoder/downsample_output/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/ConstantOfShape [ConstantOfShape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Shape_3_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/ConstantOfShape [ConstantOfShape] inputs: [/encoder/downsample_output/Shape_3_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/ConstantOfShape_output_0 for ONNX tensor: /encoder/downsample_output/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/ConstantOfShape [ConstantOfShape] outputs: [/encoder/downsample_output/ConstantOfShape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_16 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_16 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_16 [Constant] outputs: [/encoder/downsample_output/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Mul_1 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul_1 [Mul] inputs: [/encoder/downsample_output/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/downsample_output/Constant_16_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_16_output_0 for ONNX node: /encoder/downsample_output/Constant_16_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Mul_1 for ONNX node: /encoder/downsample_output/Mul_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Mul_1_output_0 for ONNX tensor: /encoder/downsample_output/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul_1 [Mul] outputs: [/encoder/downsample_output/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Equal [Equal] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Mul_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Equal [Equal] inputs: [/encoder/downsample_output/Reshape_output_0 -> (3)[INT32]], [/encoder/downsample_output/Mul_1_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Equal for ONNX node: /encoder/downsample_output/Equal [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Equal_output_0 for ONNX tensor: /encoder/downsample_output/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Equal [Equal] outputs: [/encoder/downsample_output/Equal_output_0 -> (3)[BOOL]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Where [Where] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Equal_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/ConstantOfShape_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Reshape_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Where [Where] inputs: [/encoder/downsample_output/Equal_output_0 -> (3)[BOOL]], [/encoder/downsample_output/ConstantOfShape_output_0 -> (3)[INT32]], [/encoder/downsample_output/Reshape_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Where for ONNX node: /encoder/downsample_output/Where [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Where_output_0 for ONNX tensor: /encoder/downsample_output/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Where [Where] outputs: [/encoder/downsample_output/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Expand [Expand] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Slice_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Where_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Expand [Expand] inputs: [/encoder/downsample_output/Slice_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/downsample_output/Where_output_0 -> (3)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Expand for ONNX node: /encoder/downsample_output/Expand [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Expand_output_0 for ONNX tensor: /encoder/downsample_output/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Expand [Expand] outputs: [/encoder/downsample_output/Expand_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Concat_1 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Concat_6_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Expand_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat_1 [Concat] inputs: [/encoder/Concat_6_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/downsample_output/Expand_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Concat_1 for ONNX node: /encoder/downsample_output/Concat_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Concat_1_output_0 for ONNX tensor: /encoder/downsample_output/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat_1 [Concat] outputs: [/encoder/downsample_output/Concat_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7833 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7833 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7833 [Constant] outputs: [onnx::Unsqueeze_9150 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_4 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9150 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_4 [Unsqueeze] inputs: [/encoder/downsample_output/Cast_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_9150 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_4 for ONNX node: /encoder/downsample_output/Unsqueeze_4 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_4_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_4 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_4_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Constant_17 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_17 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Constant_17 [Constant] outputs: [/encoder/downsample_output/Constant_17_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7836 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7836 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7836 [Constant] outputs: [onnx::Unsqueeze_9154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_5 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9154 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_5 [Unsqueeze] inputs: [/encoder/downsample_output/Gather_1_output_0 -> ()[INT32]], [onnx::Unsqueeze_9154 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_5 for ONNX node: /encoder/downsample_output/Unsqueeze_5 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_5_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_5 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_5_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: Constant_7838 [Constant] [07/20/2023-07:25:31] [V] [TRT] Constant_7838 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] Constant_7838 [Constant] outputs: [onnx::Unsqueeze_9156 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Unsqueeze_6 [Unsqueeze] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Gather_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Unsqueeze_9156 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_6 [Unsqueeze] inputs: [/encoder/downsample_output/Gather_2_output_0 -> ()[INT32]], [onnx::Unsqueeze_9156 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Original shape: (), unsqueezing to: (1,) [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Unsqueeze_6 for ONNX node: /encoder/downsample_output/Unsqueeze_6 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Unsqueeze_6_output_0 for ONNX tensor: /encoder/downsample_output/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Unsqueeze_6 [Unsqueeze] outputs: [/encoder/downsample_output/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Concat_2 [Concat] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_4_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_5_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Unsqueeze_6_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat_2 [Concat] inputs: [/encoder/downsample_output/Unsqueeze_4_output_0 -> (1)[INT32]], [/encoder/downsample_output/Constant_17_output_0 -> (1)[INT32]], [/encoder/downsample_output/Unsqueeze_5_output_0 -> (1)[INT32]], [/encoder/downsample_output/Unsqueeze_6_output_0 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Constant_17_output_0 for ONNX node: /encoder/downsample_output/Constant_17_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Concat_2 for ONNX node: /encoder/downsample_output/Concat_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Concat_2_output_0 for ONNX tensor: /encoder/downsample_output/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Concat_2 [Concat] outputs: [/encoder/downsample_output/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Reshape_1 [Reshape] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Concat_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Concat_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Reshape_1 [Reshape] inputs: [/encoder/downsample_output/Concat_1_output_0 -> (-1, -1, 512)[FLOAT]], [/encoder/downsample_output/Concat_2_output_0 -> (4)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Reshape_1 for ONNX node: /encoder/downsample_output/Reshape_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Reshape_1_output_0 for ONNX tensor: /encoder/downsample_output/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Reshape_1 [Reshape] outputs: [/encoder/downsample_output/Reshape_1_output_0 -> (-1, 2, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Softmax [Softmax] [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::Softmax_9789 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Softmax [Softmax] inputs: [onnx::Softmax_9789 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::Softmax_9789 for ONNX node: onnx::Softmax_9789 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Softmax for ONNX node: /encoder/downsample_output/Softmax [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Softmax_output_0 for ONNX tensor: /encoder/downsample_output/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Softmax [Softmax] outputs: [/encoder/downsample_output/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/Mul_2 [Mul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Reshape_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Softmax_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul_2 [Mul] inputs: [/encoder/downsample_output/Reshape_1_output_0 -> (-1, 2, -1, 512)[FLOAT]], [/encoder/downsample_output/Softmax_output_0 -> (2, 1, 1)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/Mul_2 for ONNX node: /encoder/downsample_output/Mul_2 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/Mul_2_output_0 for ONNX tensor: /encoder/downsample_output/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/Mul_2 [Mul] outputs: [/encoder/downsample_output/Mul_2_output_0 -> (-1, 2, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/downsample_output/ReduceSum [ReduceSum] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/Mul_2_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::ReduceSum_722 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/ReduceSum [ReduceSum] inputs: [/encoder/downsample_output/Mul_2_output_0 -> (-1, 2, -1, 512)[FLOAT]], [onnx::ReduceSum_722 -> (1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/downsample_output/ReduceSum for ONNX node: /encoder/downsample_output/ReduceSum [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/downsample_output/ReduceSum_output_0 for ONNX tensor: /encoder/downsample_output/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/downsample_output/ReduceSum [ReduceSum] outputs: [/encoder/downsample_output/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_44 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_44 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_44 [Constant] outputs: [/encoder/Constant_44_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder_embed/Cast_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_44_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Add [Add] inputs: [/encoder_embed/Cast_1_output_0 -> (-1)[INT32]], [/encoder/Constant_44_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_44_output_0 for ONNX node: /encoder/Constant_44_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Add for ONNX node: /encoder/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Add_output_0 for ONNX tensor: /encoder/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Add [Add] outputs: [/encoder/Add_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Constant_45 [Constant] [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_45 [Constant] inputs: [07/20/2023-07:25:31] [V] [TRT] /encoder/Constant_45 [Constant] outputs: [/encoder/Constant_45_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Div [Div] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Add_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Constant_45_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Div [Div] inputs: [/encoder/Add_output_0 -> (-1)[INT32]], [/encoder/Constant_45_output_0 -> ()[INT32]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Constant_45_output_0 for ONNX node: /encoder/Constant_45_output_0 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Div for ONNX node: /encoder/Div [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Div_output_0 for ONNX tensor: /encoder/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Div [Div] outputs: [/encoder/Div_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Cast [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Div_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Cast [Cast] inputs: [/encoder/Div_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Cast for ONNX node: /encoder/Cast [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder/Cast_output_0 for ONNX tensor: /encoder/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Cast [Cast] outputs: [/encoder/Cast_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder/Cast_1 [Cast] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/Cast_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder/Cast_1 [Cast] inputs: [/encoder/Cast_output_0 -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Casting to type: int32 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder/Cast_1 for ONNX node: /encoder/Cast_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: encoder_out_lens_4389 for ONNX tensor: encoder_out_lens [07/20/2023-07:25:31] [V] [TRT] /encoder/Cast_1 [Cast] outputs: [encoder_out_lens -> (-1)[INT32]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /Transpose_1 [Transpose] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder/downsample_output/ReduceSum_output_0 [07/20/2023-07:25:31] [V] [TRT] /Transpose_1 [Transpose] inputs: [/encoder/downsample_output/ReduceSum_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: /Transpose_1 for ONNX node: /Transpose_1 [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /Transpose_1_output_0 for ONNX tensor: /Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] /Transpose_1 [Transpose] outputs: [/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder_proj/MatMul [MatMul] [07/20/2023-07:25:31] [V] [TRT] Searching for input: /Transpose_1_output_0 [07/20/2023-07:25:31] [V] [TRT] Searching for input: onnx::MatMul_9790 [07/20/2023-07:25:31] [V] [TRT] /encoder_proj/MatMul [MatMul] inputs: [/Transpose_1_output_0 -> (-1, -1, 512)[FLOAT]], [onnx::MatMul_9790 -> (512, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: onnx::MatMul_9790 for ONNX node: onnx::MatMul_9790 [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder_proj/MatMul for ONNX node: /encoder_proj/MatMul [07/20/2023-07:25:31] [V] [TRT] Registering tensor: /encoder_proj/MatMul_output_0 for ONNX tensor: /encoder_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder_proj/MatMul [MatMul] outputs: [/encoder_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Parsing node: /encoder_proj/Add [Add] [07/20/2023-07:25:31] [V] [TRT] Searching for input: encoder_proj.bias [07/20/2023-07:25:31] [V] [TRT] Searching for input: /encoder_proj/MatMul_output_0 [07/20/2023-07:25:31] [V] [TRT] /encoder_proj/Add [Add] inputs: [encoder_proj.bias -> (512)[FLOAT]], [/encoder_proj/MatMul_output_0 -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Registering layer: encoder_proj.bias for ONNX node: encoder_proj.bias [07/20/2023-07:25:31] [V] [TRT] Registering layer: /encoder_proj/Add for ONNX node: /encoder_proj/Add [07/20/2023-07:25:31] [V] [TRT] Registering tensor: encoder_out_4390 for ONNX tensor: encoder_out [07/20/2023-07:25:31] [V] [TRT] /encoder_proj/Add [Add] outputs: [encoder_out -> (-1, -1, 512)[FLOAT]], [07/20/2023-07:25:31] [V] [TRT] Marking encoder_out_4390 as output: encoder_out [07/20/2023-07:25:31] [V] [TRT] Marking encoder_out_lens_4389 as output: encoder_out_lens [07/20/2023-07:25:31] [I] Finished parsing network model. Parse time: 1.46883 [07/20/2023-07:25:32] [V] [TRT] Original: 5457 layers [07/20/2023-07:25:32] [V] [TRT] After dead-layer removal: 5457 layers [07/20/2023-07:25:32] [V] [TRT] Graph construction completed in 0.530856 seconds. [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_output_0 with (Unnamed Layer* 8) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_1_output_0 with (Unnamed Layer* 11) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_2_output_0 with (Unnamed Layer* 14) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_3_output_0 with (Unnamed Layer* 20) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_4_output_0 with (Unnamed Layer* 25) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/3/Constant_5_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/3/Constant_5_output_0 with (Unnamed Layer* 29) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_output_0 with (Unnamed Layer* 33) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_1_output_0 with (Unnamed Layer* 36) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_2_output_0 with (Unnamed Layer* 39) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_3_output_0 with (Unnamed Layer* 45) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_4_output_0 with (Unnamed Layer* 50) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/6/Constant_5_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/6/Constant_5_output_0 with (Unnamed Layer* 54) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_output_0 with (Unnamed Layer* 58) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_1_output_0 with (Unnamed Layer* 61) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_2_output_0 with (Unnamed Layer* 64) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_3_output_0 with (Unnamed Layer* 70) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_4_output_0 with (Unnamed Layer* 75) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/conv/9/Constant_5_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/conv/9/Constant_5_output_0 with (Unnamed Layer* 79) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_output_0 with (Unnamed Layer* 84) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_1_output_0 with (Unnamed Layer* 87) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_2_output_0 with (Unnamed Layer* 90) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_3_output_0 with (Unnamed Layer* 96) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_4_output_0 with (Unnamed Layer* 101) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/convnext/activation/Constant_5_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/convnext/activation/Constant_5_output_0 with (Unnamed Layer* 105) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9177 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9177 with (Unnamed Layer* 129) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder_embed.out.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder_embed.out.bias with (Unnamed Layer* 132) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder_embed.out_norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder_embed.out_norm.bias with (Unnamed Layer* 135) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/out_norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/out_norm/Constant_output_0 with (Unnamed Layer* 138) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder_embed/out_norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder_embed/out_norm/Constant_1_output_0 with (Unnamed Layer* 142) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9180 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9180 with (Unnamed Layer* 280) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 283) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9187 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9187 with (Unnamed Layer* 389) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/self_attn_weights/Constant_37_output_0 with (Unnamed Layer* 488) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9194 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9194 with (Unnamed Layer* 498) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 501) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 504) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 508) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 513) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 517) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 521) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9195 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9195 with (Unnamed Layer* 524) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 527) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9196 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9196 with (Unnamed Layer* 556) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 559) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9200 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9200 with (Unnamed Layer* 700) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 703) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9201 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9201 with (Unnamed Layer* 716) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 719) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9203 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9203 with (Unnamed Layer* 740) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 743) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9204 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9204 with (Unnamed Layer* 747) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 750) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 832) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 847) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 851) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 856) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 860) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 864) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9205 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9205 with (Unnamed Layer* 867) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 870) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9206 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9206 with (Unnamed Layer* 874) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 877) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 880) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 884) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 889) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 893) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 897) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9207 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9207 with (Unnamed Layer* 900) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 903) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 908) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9208 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9208 with (Unnamed Layer* 918) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 921) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9210 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9210 with (Unnamed Layer* 942) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 945) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9211 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9211 with (Unnamed Layer* 949) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 952) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 1034) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 1049) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 1053) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 1058) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 1062) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 1066) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9212 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9212 with (Unnamed Layer* 1069) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 1072) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9213 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9213 with (Unnamed Layer* 1076) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 1079) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 1082) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 1086) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 1091) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 1095) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 1099) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9214 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9214 with (Unnamed Layer* 1102) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 1105) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.norm.bias with (Unnamed Layer* 1109) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/norm/Constant_output_0 with (Unnamed Layer* 1112) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.0/norm/Constant_1_output_0 with (Unnamed Layer* 1116) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.0.bypass.bypass_scale with (Unnamed Layer* 1125) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9215 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9215 with (Unnamed Layer* 1129) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 1132) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9222 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9222 with (Unnamed Layer* 1238) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 1331) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9229 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9229 with (Unnamed Layer* 1341) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 1344) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 1347) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 1351) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 1356) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 1360) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 1364) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9230 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9230 with (Unnamed Layer* 1367) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 1370) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9231 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9231 with (Unnamed Layer* 1399) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 1402) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9235 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9235 with (Unnamed Layer* 1543) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 1546) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9236 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9236 with (Unnamed Layer* 1559) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 1562) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9238 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9238 with (Unnamed Layer* 1583) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 1586) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9239 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9239 with (Unnamed Layer* 1590) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 1593) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 1675) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 1690) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 1694) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 1699) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 1703) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 1707) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9240 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9240 with (Unnamed Layer* 1710) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 1713) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9241 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9241 with (Unnamed Layer* 1717) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 1720) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 1723) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 1727) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 1732) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 1736) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 1740) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9242 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9242 with (Unnamed Layer* 1743) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 1746) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 1751) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9243 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9243 with (Unnamed Layer* 1761) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 1764) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9245 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9245 with (Unnamed Layer* 1785) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 1788) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9246 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9246 with (Unnamed Layer* 1792) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 1795) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 1877) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 1892) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 1896) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 1901) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 1905) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 1909) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9247 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9247 with (Unnamed Layer* 1912) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 1915) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9248 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9248 with (Unnamed Layer* 1919) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 1922) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 1925) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 1929) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 1934) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 1938) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 1942) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9249 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9249 with (Unnamed Layer* 1945) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 1948) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.norm.bias with (Unnamed Layer* 1952) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/norm/Constant_output_0 with (Unnamed Layer* 1955) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/0/layers.1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/0/layers.1/norm/Constant_1_output_0 with (Unnamed Layer* 1959) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.0.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.0.layers.1.bypass.bypass_scale with (Unnamed Layer* 1968) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on (Unnamed Layer* 1986) [Constant] [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 1986) [Constant] with (Unnamed Layer* 1987) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9256 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9256 with (Unnamed Layer* 2156) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 2159) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9263 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9263 with (Unnamed Layer* 2265) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/self_attn_weights/Constant_37_output_0 with (Unnamed Layer* 2364) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9270 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9270 with (Unnamed Layer* 2374) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 2377) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 2380) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 2384) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 2389) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 2393) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 2397) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9271 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9271 with (Unnamed Layer* 2400) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 2403) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9272 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9272 with (Unnamed Layer* 2432) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 2435) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9276 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9276 with (Unnamed Layer* 2576) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 2579) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9277 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9277 with (Unnamed Layer* 2592) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 2595) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9279 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9279 with (Unnamed Layer* 2616) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 2619) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9280 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9280 with (Unnamed Layer* 2623) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 2626) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 2708) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 2723) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 2727) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 2732) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 2736) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 2740) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9281 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9281 with (Unnamed Layer* 2743) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 2746) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9282 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9282 with (Unnamed Layer* 2750) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 2753) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 2756) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 2760) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 2765) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 2769) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 2773) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9283 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9283 with (Unnamed Layer* 2776) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 2779) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 2784) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9284 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9284 with (Unnamed Layer* 2794) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 2797) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9286 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9286 with (Unnamed Layer* 2818) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 2821) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9287 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9287 with (Unnamed Layer* 2825) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 2828) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 2910) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 2925) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 2929) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 2934) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 2938) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 2942) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9288 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9288 with (Unnamed Layer* 2945) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 2948) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9289 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9289 with (Unnamed Layer* 2952) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 2955) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 2958) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 2962) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 2967) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 2971) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 2975) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9290 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9290 with (Unnamed Layer* 2978) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 2981) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.norm.bias with (Unnamed Layer* 2985) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/norm/Constant_output_0 with (Unnamed Layer* 2988) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/0/norm/Constant_1_output_0 with (Unnamed Layer* 2992) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.0.bypass.bypass_scale with (Unnamed Layer* 3001) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9291 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9291 with (Unnamed Layer* 3005) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 3008) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9298 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9298 with (Unnamed Layer* 3114) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 3207) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9305 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9305 with (Unnamed Layer* 3217) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 3220) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 3223) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 3227) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 3232) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 3236) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 3240) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9306 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9306 with (Unnamed Layer* 3243) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 3246) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9307 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9307 with (Unnamed Layer* 3275) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 3278) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9311 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9311 with (Unnamed Layer* 3419) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 3422) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9312 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9312 with (Unnamed Layer* 3435) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 3438) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9314 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9314 with (Unnamed Layer* 3459) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 3462) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9315 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9315 with (Unnamed Layer* 3466) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 3469) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 3551) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 3566) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 3570) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 3575) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 3579) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 3583) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9316 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9316 with (Unnamed Layer* 3586) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 3589) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9317 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9317 with (Unnamed Layer* 3593) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 3596) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 3599) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 3603) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 3608) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 3612) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 3616) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9318 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9318 with (Unnamed Layer* 3619) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 3622) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 3627) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9319 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9319 with (Unnamed Layer* 3637) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 3640) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9321 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9321 with (Unnamed Layer* 3661) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 3664) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9322 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9322 with (Unnamed Layer* 3668) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 3671) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 3753) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 3768) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 3772) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 3777) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 3781) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 3785) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9323 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9323 with (Unnamed Layer* 3788) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 3791) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9324 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9324 with (Unnamed Layer* 3795) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 3798) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 3801) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 3805) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 3810) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 3814) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 3818) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9325 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9325 with (Unnamed Layer* 3821) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 3824) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.norm.bias with (Unnamed Layer* 3828) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/norm/Constant_output_0 with (Unnamed Layer* 3831) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/1/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/1/encoder/1/norm/Constant_1_output_0 with (Unnamed Layer* 3835) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.encoder.layers.1.bypass.bypass_scale with (Unnamed Layer* 3844) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.1.out_combiner.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.1.out_combiner.bypass_scale with (Unnamed Layer* 3920) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on (Unnamed Layer* 3938) [Constant] [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 3938) [Constant] with (Unnamed Layer* 3939) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9335 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9335 with (Unnamed Layer* 4108) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 4111) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9342 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9342 with (Unnamed Layer* 4217) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/self_attn_weights/Constant_37_output_0 with (Unnamed Layer* 4316) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9349 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9349 with (Unnamed Layer* 4326) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 4329) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 4332) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 4336) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 4341) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 4345) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 4349) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9350 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9350 with (Unnamed Layer* 4352) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 4355) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9351 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9351 with (Unnamed Layer* 4384) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 4387) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9355 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9355 with (Unnamed Layer* 4528) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 4531) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9356 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9356 with (Unnamed Layer* 4544) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 4547) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9358 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9358 with (Unnamed Layer* 4568) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 4571) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9359 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9359 with (Unnamed Layer* 4575) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 4578) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 4660) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 4675) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 4679) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 4684) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 4688) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 4692) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9360 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9360 with (Unnamed Layer* 4695) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 4698) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9361 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9361 with (Unnamed Layer* 4702) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 4705) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 4708) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 4712) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 4717) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 4721) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 4725) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9362 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9362 with (Unnamed Layer* 4728) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 4731) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 4736) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9363 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9363 with (Unnamed Layer* 4746) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 4749) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9365 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9365 with (Unnamed Layer* 4770) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 4773) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9366 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9366 with (Unnamed Layer* 4777) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 4780) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 4862) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 4877) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 4881) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 4886) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 4890) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 4894) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9367 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9367 with (Unnamed Layer* 4897) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 4900) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9368 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9368 with (Unnamed Layer* 4904) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 4907) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 4910) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 4914) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 4919) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 4923) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 4927) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9369 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9369 with (Unnamed Layer* 4930) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 4933) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.norm.bias with (Unnamed Layer* 4937) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/norm/Constant_output_0 with (Unnamed Layer* 4940) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/0/norm/Constant_1_output_0 with (Unnamed Layer* 4944) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.0.bypass.bypass_scale with (Unnamed Layer* 4953) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9370 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9370 with (Unnamed Layer* 4957) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 4960) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9377 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9377 with (Unnamed Layer* 5066) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 5159) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9384 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9384 with (Unnamed Layer* 5169) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 5172) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 5175) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 5179) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 5184) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 5188) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 5192) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9385 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9385 with (Unnamed Layer* 5195) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 5198) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9386 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9386 with (Unnamed Layer* 5227) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 5230) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9390 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9390 with (Unnamed Layer* 5371) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 5374) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9391 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9391 with (Unnamed Layer* 5387) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 5390) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9393 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9393 with (Unnamed Layer* 5411) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 5414) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9394 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9394 with (Unnamed Layer* 5418) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 5421) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 5503) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 5518) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 5522) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 5527) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 5531) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 5535) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9395 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9395 with (Unnamed Layer* 5538) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 5541) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9396 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9396 with (Unnamed Layer* 5545) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 5548) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 5551) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 5555) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 5560) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 5564) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 5568) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9397 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9397 with (Unnamed Layer* 5571) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 5574) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 5579) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9398 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9398 with (Unnamed Layer* 5589) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 5592) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9400 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9400 with (Unnamed Layer* 5613) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 5616) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9401 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9401 with (Unnamed Layer* 5620) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 5623) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 5705) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 5720) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 5724) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 5729) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 5733) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 5737) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9402 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9402 with (Unnamed Layer* 5740) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 5743) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9403 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9403 with (Unnamed Layer* 5747) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 5750) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 5753) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 5757) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 5762) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 5766) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 5770) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9404 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9404 with (Unnamed Layer* 5773) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 5776) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.norm.bias with (Unnamed Layer* 5780) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/norm/Constant_output_0 with (Unnamed Layer* 5783) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/1/norm/Constant_1_output_0 with (Unnamed Layer* 5787) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.1.bypass.bypass_scale with (Unnamed Layer* 5796) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9405 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9405 with (Unnamed Layer* 5800) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.self_attn_weights.in_proj.bias with (Unnamed Layer* 5803) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9412 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9412 with (Unnamed Layer* 5909) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 6002) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9419 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9419 with (Unnamed Layer* 6012) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward1.in_proj.bias with (Unnamed Layer* 6015) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 6018) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 6022) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 6027) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 6031) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 6035) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9420 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9420 with (Unnamed Layer* 6038) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward1.out_proj.bias with (Unnamed Layer* 6041) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9421 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9421 with (Unnamed Layer* 6070) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.nonlin_attention.in_proj.bias with (Unnamed Layer* 6073) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9425 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9425 with (Unnamed Layer* 6214) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.nonlin_attention.out_proj.bias with (Unnamed Layer* 6217) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9426 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9426 with (Unnamed Layer* 6230) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.self_attn1.in_proj.bias with (Unnamed Layer* 6233) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9428 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9428 with (Unnamed Layer* 6254) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.self_attn1.out_proj.bias with (Unnamed Layer* 6257) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9429 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9429 with (Unnamed Layer* 6261) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.conv_module1.in_proj.bias with (Unnamed Layer* 6264) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/Constant_6_output_0 with (Unnamed Layer* 6346) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 6361) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 6365) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 6370) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 6374) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 6378) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9430 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9430 with (Unnamed Layer* 6381) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.conv_module1.out_proj.bias with (Unnamed Layer* 6384) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9431 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9431 with (Unnamed Layer* 6388) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward2.in_proj.bias with (Unnamed Layer* 6391) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 6394) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 6398) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 6403) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 6407) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 6411) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9432 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9432 with (Unnamed Layer* 6414) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward2.out_proj.bias with (Unnamed Layer* 6417) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.bypass_mid.bypass_scale with (Unnamed Layer* 6422) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9433 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9433 with (Unnamed Layer* 6432) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.self_attn2.in_proj.bias with (Unnamed Layer* 6435) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9435 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9435 with (Unnamed Layer* 6456) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.self_attn2.out_proj.bias with (Unnamed Layer* 6459) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9436 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9436 with (Unnamed Layer* 6463) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.conv_module2.in_proj.bias with (Unnamed Layer* 6466) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/Constant_6_output_0 with (Unnamed Layer* 6548) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 6563) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 6567) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 6572) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 6576) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 6580) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9437 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9437 with (Unnamed Layer* 6583) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.conv_module2.out_proj.bias with (Unnamed Layer* 6586) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9438 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9438 with (Unnamed Layer* 6590) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward3.in_proj.bias with (Unnamed Layer* 6593) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 6596) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 6600) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 6605) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 6609) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 6613) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9439 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9439 with (Unnamed Layer* 6616) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.feed_forward3.out_proj.bias with (Unnamed Layer* 6619) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.norm.bias with (Unnamed Layer* 6623) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/norm/Constant_output_0 with (Unnamed Layer* 6626) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/2/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/2/encoder/2/norm/Constant_1_output_0 with (Unnamed Layer* 6630) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.encoder.layers.2.bypass.bypass_scale with (Unnamed Layer* 6639) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.2.out_combiner.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.2.out_combiner.bypass_scale with (Unnamed Layer* 6715) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on (Unnamed Layer* 6733) [Constant] [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 6733) [Constant] with (Unnamed Layer* 6734) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9449 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9449 with (Unnamed Layer* 6903) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 6906) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9456 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9456 with (Unnamed Layer* 7012) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/self_attn_weights/Constant_37_output_0 with (Unnamed Layer* 7111) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9463 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9463 with (Unnamed Layer* 7121) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 7124) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 7127) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 7131) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 7136) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 7140) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 7144) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9464 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9464 with (Unnamed Layer* 7147) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 7150) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9465 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9465 with (Unnamed Layer* 7179) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 7182) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9469 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9469 with (Unnamed Layer* 7323) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 7326) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9470 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9470 with (Unnamed Layer* 7339) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 7342) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9472 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9472 with (Unnamed Layer* 7363) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 7366) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9473 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9473 with (Unnamed Layer* 7370) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 7373) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 7455) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 7470) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 7474) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 7479) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 7483) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 7487) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9474 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9474 with (Unnamed Layer* 7490) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 7493) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9475 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9475 with (Unnamed Layer* 7497) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 7500) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 7503) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 7507) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 7512) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 7516) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 7520) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9476 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9476 with (Unnamed Layer* 7523) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 7526) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 7531) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9477 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9477 with (Unnamed Layer* 7541) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 7544) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9479 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9479 with (Unnamed Layer* 7565) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 7568) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9480 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9480 with (Unnamed Layer* 7572) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 7575) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 7657) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 7672) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 7676) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 7681) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 7685) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 7689) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9481 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9481 with (Unnamed Layer* 7692) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 7695) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9482 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9482 with (Unnamed Layer* 7699) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 7702) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 7705) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 7709) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 7714) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 7718) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 7722) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9483 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9483 with (Unnamed Layer* 7725) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 7728) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.norm.bias with (Unnamed Layer* 7732) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/norm/Constant_output_0 with (Unnamed Layer* 7735) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/0/norm/Constant_1_output_0 with (Unnamed Layer* 7739) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.0.bypass.bypass_scale with (Unnamed Layer* 7748) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9484 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9484 with (Unnamed Layer* 7752) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 7755) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9491 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9491 with (Unnamed Layer* 7861) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 7954) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9498 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9498 with (Unnamed Layer* 7964) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 7967) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 7970) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 7974) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 7979) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 7983) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 7987) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9499 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9499 with (Unnamed Layer* 7990) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 7993) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9500 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9500 with (Unnamed Layer* 8022) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 8025) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9504 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9504 with (Unnamed Layer* 8166) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 8169) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9505 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9505 with (Unnamed Layer* 8182) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 8185) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9507 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9507 with (Unnamed Layer* 8206) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 8209) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9508 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9508 with (Unnamed Layer* 8213) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 8216) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 8298) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 8313) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 8317) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 8322) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 8326) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 8330) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9509 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9509 with (Unnamed Layer* 8333) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 8336) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9510 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9510 with (Unnamed Layer* 8340) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 8343) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 8346) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 8350) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 8355) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 8359) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 8363) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9511 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9511 with (Unnamed Layer* 8366) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 8369) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 8374) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9512 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9512 with (Unnamed Layer* 8384) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 8387) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9514 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9514 with (Unnamed Layer* 8408) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 8411) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9515 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9515 with (Unnamed Layer* 8415) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 8418) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 8500) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 8515) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 8519) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 8524) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 8528) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 8532) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9516 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9516 with (Unnamed Layer* 8535) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 8538) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9517 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9517 with (Unnamed Layer* 8542) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 8545) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 8548) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 8552) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 8557) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 8561) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 8565) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9518 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9518 with (Unnamed Layer* 8568) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 8571) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.norm.bias with (Unnamed Layer* 8575) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/norm/Constant_output_0 with (Unnamed Layer* 8578) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/1/norm/Constant_1_output_0 with (Unnamed Layer* 8582) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.1.bypass.bypass_scale with (Unnamed Layer* 8591) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9519 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9519 with (Unnamed Layer* 8595) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.self_attn_weights.in_proj.bias with (Unnamed Layer* 8598) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9526 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9526 with (Unnamed Layer* 8704) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 8797) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9533 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9533 with (Unnamed Layer* 8807) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward1.in_proj.bias with (Unnamed Layer* 8810) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 8813) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 8817) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 8822) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 8826) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 8830) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9534 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9534 with (Unnamed Layer* 8833) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward1.out_proj.bias with (Unnamed Layer* 8836) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9535 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9535 with (Unnamed Layer* 8865) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.nonlin_attention.in_proj.bias with (Unnamed Layer* 8868) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9539 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9539 with (Unnamed Layer* 9009) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.nonlin_attention.out_proj.bias with (Unnamed Layer* 9012) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9540 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9540 with (Unnamed Layer* 9025) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.self_attn1.in_proj.bias with (Unnamed Layer* 9028) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9542 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9542 with (Unnamed Layer* 9049) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.self_attn1.out_proj.bias with (Unnamed Layer* 9052) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9543 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9543 with (Unnamed Layer* 9056) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.conv_module1.in_proj.bias with (Unnamed Layer* 9059) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/Constant_6_output_0 with (Unnamed Layer* 9141) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 9156) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 9160) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 9165) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 9169) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 9173) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9544 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9544 with (Unnamed Layer* 9176) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.conv_module1.out_proj.bias with (Unnamed Layer* 9179) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9545 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9545 with (Unnamed Layer* 9183) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward2.in_proj.bias with (Unnamed Layer* 9186) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 9189) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 9193) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 9198) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 9202) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 9206) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9546 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9546 with (Unnamed Layer* 9209) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward2.out_proj.bias with (Unnamed Layer* 9212) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.bypass_mid.bypass_scale with (Unnamed Layer* 9217) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9547 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9547 with (Unnamed Layer* 9227) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.self_attn2.in_proj.bias with (Unnamed Layer* 9230) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9549 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9549 with (Unnamed Layer* 9251) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.self_attn2.out_proj.bias with (Unnamed Layer* 9254) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9550 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9550 with (Unnamed Layer* 9258) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.conv_module2.in_proj.bias with (Unnamed Layer* 9261) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/Constant_6_output_0 with (Unnamed Layer* 9343) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 9358) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 9362) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 9367) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 9371) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 9375) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9551 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9551 with (Unnamed Layer* 9378) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.conv_module2.out_proj.bias with (Unnamed Layer* 9381) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9552 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9552 with (Unnamed Layer* 9385) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward3.in_proj.bias with (Unnamed Layer* 9388) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 9391) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 9395) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 9400) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 9404) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 9408) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9553 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9553 with (Unnamed Layer* 9411) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.feed_forward3.out_proj.bias with (Unnamed Layer* 9414) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.norm.bias with (Unnamed Layer* 9418) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/norm/Constant_output_0 with (Unnamed Layer* 9421) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/2/norm/Constant_1_output_0 with (Unnamed Layer* 9425) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.2.bypass.bypass_scale with (Unnamed Layer* 9434) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9554 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9554 with (Unnamed Layer* 9438) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.self_attn_weights.in_proj.bias with (Unnamed Layer* 9441) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9561 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9561 with (Unnamed Layer* 9547) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 9640) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9568 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9568 with (Unnamed Layer* 9650) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward1.in_proj.bias with (Unnamed Layer* 9653) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 9656) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 9660) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 9665) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 9669) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 9673) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9569 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9569 with (Unnamed Layer* 9676) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward1.out_proj.bias with (Unnamed Layer* 9679) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9570 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9570 with (Unnamed Layer* 9708) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.nonlin_attention.in_proj.bias with (Unnamed Layer* 9711) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9574 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9574 with (Unnamed Layer* 9852) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.nonlin_attention.out_proj.bias with (Unnamed Layer* 9855) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9575 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9575 with (Unnamed Layer* 9868) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.self_attn1.in_proj.bias with (Unnamed Layer* 9871) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9577 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9577 with (Unnamed Layer* 9892) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.self_attn1.out_proj.bias with (Unnamed Layer* 9895) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9578 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9578 with (Unnamed Layer* 9899) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.conv_module1.in_proj.bias with (Unnamed Layer* 9902) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/Constant_6_output_0 with (Unnamed Layer* 9984) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 9999) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 10003) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 10008) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 10012) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 10016) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9579 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9579 with (Unnamed Layer* 10019) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.conv_module1.out_proj.bias with (Unnamed Layer* 10022) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9580 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9580 with (Unnamed Layer* 10026) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward2.in_proj.bias with (Unnamed Layer* 10029) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 10032) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 10036) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 10041) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 10045) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 10049) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9581 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9581 with (Unnamed Layer* 10052) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward2.out_proj.bias with (Unnamed Layer* 10055) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.bypass_mid.bypass_scale with (Unnamed Layer* 10060) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9582 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9582 with (Unnamed Layer* 10070) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.self_attn2.in_proj.bias with (Unnamed Layer* 10073) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9584 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9584 with (Unnamed Layer* 10094) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.self_attn2.out_proj.bias with (Unnamed Layer* 10097) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9585 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9585 with (Unnamed Layer* 10101) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.conv_module2.in_proj.bias with (Unnamed Layer* 10104) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/Constant_6_output_0 with (Unnamed Layer* 10186) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 10201) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 10205) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 10210) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 10214) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 10218) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9586 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9586 with (Unnamed Layer* 10221) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.conv_module2.out_proj.bias with (Unnamed Layer* 10224) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9587 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9587 with (Unnamed Layer* 10228) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward3.in_proj.bias with (Unnamed Layer* 10231) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 10234) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 10238) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 10243) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 10247) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 10251) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9588 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9588 with (Unnamed Layer* 10254) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.feed_forward3.out_proj.bias with (Unnamed Layer* 10257) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.norm.bias with (Unnamed Layer* 10261) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/norm/Constant_output_0 with (Unnamed Layer* 10264) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/3/encoder/3/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/3/encoder/3/norm/Constant_1_output_0 with (Unnamed Layer* 10268) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.encoder.layers.3.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.encoder.layers.3.bypass.bypass_scale with (Unnamed Layer* 10277) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.3.out_combiner.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.3.out_combiner.bypass_scale with (Unnamed Layer* 10353) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9598 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9598 with (Unnamed Layer* 10518) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 10521) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9605 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9605 with (Unnamed Layer* 10627) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 10720) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9612 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9612 with (Unnamed Layer* 10730) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 10733) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 10736) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 10740) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 10745) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 10749) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 10753) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9613 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9613 with (Unnamed Layer* 10756) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 10759) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9614 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9614 with (Unnamed Layer* 10788) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 10791) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9618 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9618 with (Unnamed Layer* 10932) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 10935) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9619 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9619 with (Unnamed Layer* 10948) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 10951) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9621 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9621 with (Unnamed Layer* 10972) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 10975) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9622 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9622 with (Unnamed Layer* 10979) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 10982) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 11064) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 11079) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 11083) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 11088) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 11092) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 11096) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9623 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9623 with (Unnamed Layer* 11099) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 11102) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9624 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9624 with (Unnamed Layer* 11106) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 11109) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 11112) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 11116) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 11121) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 11125) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 11129) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9625 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9625 with (Unnamed Layer* 11132) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 11135) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 11140) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9626 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9626 with (Unnamed Layer* 11150) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 11153) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9628 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9628 with (Unnamed Layer* 11174) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 11177) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9629 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9629 with (Unnamed Layer* 11181) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 11184) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 11266) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 11281) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 11285) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 11290) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 11294) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 11298) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9630 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9630 with (Unnamed Layer* 11301) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 11304) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9631 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9631 with (Unnamed Layer* 11308) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 11311) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 11314) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 11318) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 11323) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 11327) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 11331) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9632 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9632 with (Unnamed Layer* 11334) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 11337) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.norm.bias with (Unnamed Layer* 11341) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/norm/Constant_output_0 with (Unnamed Layer* 11344) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/0/norm/Constant_1_output_0 with (Unnamed Layer* 11348) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.0.bypass.bypass_scale with (Unnamed Layer* 11357) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9633 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9633 with (Unnamed Layer* 11361) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 11364) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9640 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9640 with (Unnamed Layer* 11470) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 11563) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9647 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9647 with (Unnamed Layer* 11573) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 11576) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 11579) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 11583) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 11588) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 11592) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 11596) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9648 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9648 with (Unnamed Layer* 11599) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 11602) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9649 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9649 with (Unnamed Layer* 11631) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 11634) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9653 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9653 with (Unnamed Layer* 11775) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 11778) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9654 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9654 with (Unnamed Layer* 11791) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 11794) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9656 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9656 with (Unnamed Layer* 11815) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 11818) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9657 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9657 with (Unnamed Layer* 11822) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 11825) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 11907) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 11922) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 11926) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 11931) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 11935) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 11939) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9658 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9658 with (Unnamed Layer* 11942) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 11945) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9659 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9659 with (Unnamed Layer* 11949) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 11952) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 11955) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 11959) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 11964) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 11968) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 11972) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9660 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9660 with (Unnamed Layer* 11975) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 11978) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 11983) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9661 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9661 with (Unnamed Layer* 11993) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 11996) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9663 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9663 with (Unnamed Layer* 12017) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 12020) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9664 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9664 with (Unnamed Layer* 12024) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 12027) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 12109) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 12124) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 12128) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 12133) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 12137) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 12141) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9665 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9665 with (Unnamed Layer* 12144) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 12147) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9666 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9666 with (Unnamed Layer* 12151) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 12154) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 12157) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 12161) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 12166) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 12170) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 12174) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9667 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9667 with (Unnamed Layer* 12177) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 12180) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.norm.bias with (Unnamed Layer* 12184) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/norm/Constant_output_0 with (Unnamed Layer* 12187) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/1/norm/Constant_1_output_0 with (Unnamed Layer* 12191) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.1.bypass.bypass_scale with (Unnamed Layer* 12200) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9668 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9668 with (Unnamed Layer* 12204) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.self_attn_weights.in_proj.bias with (Unnamed Layer* 12207) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9675 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9675 with (Unnamed Layer* 12313) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 12406) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9682 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9682 with (Unnamed Layer* 12416) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward1.in_proj.bias with (Unnamed Layer* 12419) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 12422) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 12426) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 12431) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 12435) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 12439) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9683 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9683 with (Unnamed Layer* 12442) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward1.out_proj.bias with (Unnamed Layer* 12445) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9684 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9684 with (Unnamed Layer* 12474) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.nonlin_attention.in_proj.bias with (Unnamed Layer* 12477) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9688 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9688 with (Unnamed Layer* 12618) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.nonlin_attention.out_proj.bias with (Unnamed Layer* 12621) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9689 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9689 with (Unnamed Layer* 12634) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.self_attn1.in_proj.bias with (Unnamed Layer* 12637) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9691 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9691 with (Unnamed Layer* 12658) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.self_attn1.out_proj.bias with (Unnamed Layer* 12661) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9692 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9692 with (Unnamed Layer* 12665) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.conv_module1.in_proj.bias with (Unnamed Layer* 12668) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/Constant_6_output_0 with (Unnamed Layer* 12750) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 12765) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 12769) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 12774) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 12778) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 12782) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9693 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9693 with (Unnamed Layer* 12785) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.conv_module1.out_proj.bias with (Unnamed Layer* 12788) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9694 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9694 with (Unnamed Layer* 12792) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward2.in_proj.bias with (Unnamed Layer* 12795) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 12798) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 12802) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 12807) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 12811) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 12815) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9695 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9695 with (Unnamed Layer* 12818) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward2.out_proj.bias with (Unnamed Layer* 12821) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.bypass_mid.bypass_scale with (Unnamed Layer* 12826) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9696 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9696 with (Unnamed Layer* 12836) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.self_attn2.in_proj.bias with (Unnamed Layer* 12839) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9698 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9698 with (Unnamed Layer* 12860) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.self_attn2.out_proj.bias with (Unnamed Layer* 12863) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9699 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9699 with (Unnamed Layer* 12867) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.conv_module2.in_proj.bias with (Unnamed Layer* 12870) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/Constant_6_output_0 with (Unnamed Layer* 12952) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 12967) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 12971) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 12976) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 12980) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 12984) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9700 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9700 with (Unnamed Layer* 12987) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.conv_module2.out_proj.bias with (Unnamed Layer* 12990) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9701 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9701 with (Unnamed Layer* 12994) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward3.in_proj.bias with (Unnamed Layer* 12997) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 13000) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 13004) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 13009) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 13013) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 13017) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9702 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9702 with (Unnamed Layer* 13020) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.feed_forward3.out_proj.bias with (Unnamed Layer* 13023) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.norm.bias with (Unnamed Layer* 13027) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/norm/Constant_output_0 with (Unnamed Layer* 13030) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/4/encoder/2/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/4/encoder/2/norm/Constant_1_output_0 with (Unnamed Layer* 13034) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.encoder.layers.2.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.encoder.layers.2.bypass.bypass_scale with (Unnamed Layer* 13043) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.4.out_combiner.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.4.out_combiner.bypass_scale with (Unnamed Layer* 13119) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9712 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9712 with (Unnamed Layer* 13284) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.self_attn_weights.in_proj.bias with (Unnamed Layer* 13287) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9719 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9719 with (Unnamed Layer* 13393) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 13486) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9726 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9726 with (Unnamed Layer* 13496) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward1.in_proj.bias with (Unnamed Layer* 13499) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 13502) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 13506) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 13511) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 13515) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 13519) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9727 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9727 with (Unnamed Layer* 13522) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward1.out_proj.bias with (Unnamed Layer* 13525) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9728 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9728 with (Unnamed Layer* 13554) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.nonlin_attention.in_proj.bias with (Unnamed Layer* 13557) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9732 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9732 with (Unnamed Layer* 13698) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.nonlin_attention.out_proj.bias with (Unnamed Layer* 13701) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9733 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9733 with (Unnamed Layer* 13714) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.self_attn1.in_proj.bias with (Unnamed Layer* 13717) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9735 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9735 with (Unnamed Layer* 13738) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.self_attn1.out_proj.bias with (Unnamed Layer* 13741) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9736 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9736 with (Unnamed Layer* 13745) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.conv_module1.in_proj.bias with (Unnamed Layer* 13748) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/Constant_6_output_0 with (Unnamed Layer* 13830) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 13845) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 13849) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 13854) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 13858) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 13862) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9737 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9737 with (Unnamed Layer* 13865) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.conv_module1.out_proj.bias with (Unnamed Layer* 13868) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9738 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9738 with (Unnamed Layer* 13872) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward2.in_proj.bias with (Unnamed Layer* 13875) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 13878) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 13882) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 13887) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 13891) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 13895) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9739 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9739 with (Unnamed Layer* 13898) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward2.out_proj.bias with (Unnamed Layer* 13901) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.bypass_mid.bypass_scale with (Unnamed Layer* 13906) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9740 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9740 with (Unnamed Layer* 13916) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.self_attn2.in_proj.bias with (Unnamed Layer* 13919) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9742 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9742 with (Unnamed Layer* 13940) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.self_attn2.out_proj.bias with (Unnamed Layer* 13943) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9743 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9743 with (Unnamed Layer* 13947) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.conv_module2.in_proj.bias with (Unnamed Layer* 13950) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/Constant_6_output_0 with (Unnamed Layer* 14032) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 14047) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 14051) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 14056) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 14060) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 14064) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9744 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9744 with (Unnamed Layer* 14067) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.conv_module2.out_proj.bias with (Unnamed Layer* 14070) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9745 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9745 with (Unnamed Layer* 14074) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward3.in_proj.bias with (Unnamed Layer* 14077) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 14080) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 14084) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 14089) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 14093) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 14097) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9746 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9746 with (Unnamed Layer* 14100) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.feed_forward3.out_proj.bias with (Unnamed Layer* 14103) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.norm.bias with (Unnamed Layer* 14107) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/norm/Constant_output_0 with (Unnamed Layer* 14110) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/0/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/0/norm/Constant_1_output_0 with (Unnamed Layer* 14114) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.0.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.0.bypass.bypass_scale with (Unnamed Layer* 14123) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9747 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9747 with (Unnamed Layer* 14127) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.self_attn_weights.in_proj.bias with (Unnamed Layer* 14130) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9754 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9754 with (Unnamed Layer* 14236) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/self_attn_weights/Constant_36_output_0 with (Unnamed Layer* 14329) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9761 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9761 with (Unnamed Layer* 14339) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward1.in_proj.bias with (Unnamed Layer* 14342) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward1/out_proj/Constant_output_0 with (Unnamed Layer* 14345) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward1/out_proj/Constant_1_output_0 with (Unnamed Layer* 14349) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward1/out_proj/Constant_2_output_0 with (Unnamed Layer* 14354) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward1/out_proj/Constant_3_output_0 with (Unnamed Layer* 14358) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward1/out_proj/Constant_4_output_0 with (Unnamed Layer* 14362) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9762 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9762 with (Unnamed Layer* 14365) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward1.out_proj.bias with (Unnamed Layer* 14368) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9763 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9763 with (Unnamed Layer* 14397) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.nonlin_attention.in_proj.bias with (Unnamed Layer* 14400) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9767 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9767 with (Unnamed Layer* 14541) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.nonlin_attention.out_proj.bias with (Unnamed Layer* 14544) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9768 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9768 with (Unnamed Layer* 14557) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.self_attn1.in_proj.bias with (Unnamed Layer* 14560) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9770 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9770 with (Unnamed Layer* 14581) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.self_attn1.out_proj.bias with (Unnamed Layer* 14584) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9771 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9771 with (Unnamed Layer* 14588) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.conv_module1.in_proj.bias with (Unnamed Layer* 14591) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/Constant_6_output_0 with (Unnamed Layer* 14673) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/out_proj/Constant_output_0 with (Unnamed Layer* 14688) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/out_proj/Constant_1_output_0 with (Unnamed Layer* 14692) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/out_proj/Constant_2_output_0 with (Unnamed Layer* 14697) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/out_proj/Constant_3_output_0 with (Unnamed Layer* 14701) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module1/out_proj/Constant_4_output_0 with (Unnamed Layer* 14705) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9772 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9772 with (Unnamed Layer* 14708) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.conv_module1.out_proj.bias with (Unnamed Layer* 14711) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9773 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9773 with (Unnamed Layer* 14715) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward2.in_proj.bias with (Unnamed Layer* 14718) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward2/out_proj/Constant_output_0 with (Unnamed Layer* 14721) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward2/out_proj/Constant_1_output_0 with (Unnamed Layer* 14725) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward2/out_proj/Constant_2_output_0 with (Unnamed Layer* 14730) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward2/out_proj/Constant_3_output_0 with (Unnamed Layer* 14734) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward2/out_proj/Constant_4_output_0 with (Unnamed Layer* 14738) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9774 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9774 with (Unnamed Layer* 14741) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward2.out_proj.bias with (Unnamed Layer* 14744) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.bypass_mid.bypass_scale with (Unnamed Layer* 14749) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9775 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9775 with (Unnamed Layer* 14759) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.self_attn2.in_proj.bias with (Unnamed Layer* 14762) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9777 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9777 with (Unnamed Layer* 14783) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.self_attn2.out_proj.bias with (Unnamed Layer* 14786) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9778 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9778 with (Unnamed Layer* 14790) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.conv_module2.in_proj.bias with (Unnamed Layer* 14793) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/Constant_6_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/Constant_6_output_0 with (Unnamed Layer* 14875) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/out_proj/Constant_output_0 with (Unnamed Layer* 14890) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/out_proj/Constant_1_output_0 with (Unnamed Layer* 14894) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/out_proj/Constant_2_output_0 with (Unnamed Layer* 14899) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/out_proj/Constant_3_output_0 with (Unnamed Layer* 14903) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/conv_module2/out_proj/Constant_4_output_0 with (Unnamed Layer* 14907) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9779 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9779 with (Unnamed Layer* 14910) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.conv_module2.out_proj.bias with (Unnamed Layer* 14913) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9780 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9780 with (Unnamed Layer* 14917) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward3.in_proj.bias with (Unnamed Layer* 14920) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward3/out_proj/Constant_output_0 with (Unnamed Layer* 14923) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward3/out_proj/Constant_1_output_0 with (Unnamed Layer* 14927) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward3/out_proj/Constant_2_output_0 with (Unnamed Layer* 14932) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward3/out_proj/Constant_3_output_0 with (Unnamed Layer* 14936) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/feed_forward3/out_proj/Constant_4_output_0 with (Unnamed Layer* 14940) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9781 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9781 with (Unnamed Layer* 14943) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.feed_forward3.out_proj.bias with (Unnamed Layer* 14946) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.norm.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.norm.bias with (Unnamed Layer* 14950) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/norm/Constant_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/norm/Constant_output_0 with (Unnamed Layer* 14953) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on /encoder/5/encoder/1/norm/Constant_1_output_0 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing /encoder/5/encoder/1/norm/Constant_1_output_0 with (Unnamed Layer* 14957) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.encoder.layers.1.bypass.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.encoder.layers.1.bypass.bypass_scale with (Unnamed Layer* 14966) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder.encoders.5.out_combiner.bypass_scale [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder.encoders.5.out_combiner.bypass_scale with (Unnamed Layer* 15042) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on onnx::MatMul_9790 [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing onnx::MatMul_9790 with (Unnamed Layer* 15195) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ConstShuffleFusion on encoder_proj.bias [07/20/2023-07:25:32] [V] [TRT] ConstShuffleFusion: Fusing encoder_proj.bias with (Unnamed Layer* 15198) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 2104) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 2104) [Shuffle] with (Unnamed Layer* 2105) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 4056) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 4056) [Shuffle] with (Unnamed Layer* 4057) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 6851) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 6851) [Shuffle] with (Unnamed Layer* 6852) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 10466) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 10466) [Shuffle] with (Unnamed Layer* 10467) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 13232) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 13232) [Shuffle] with (Unnamed Layer* 13233) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 15181) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 15181) [Shuffle] with (Unnamed Layer* 15182) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder_embed/Transpose [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder_embed/Transpose with /encoder_embed/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn_weights/Reshape with /encoder/0/layers.0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn_weights/Reshape_2 with /encoder/0/layers.0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn_weights/Reshape_1 with /encoder/0/layers.0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn_weights/Reshape_3 with /encoder/0/layers.0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/nonlin_attention/Unsqueeze with /encoder/0/layers.0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/0/layers.0/nonlin_attention/Unsqueeze + /encoder/0/layers.0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/0/layers.0/nonlin_attention/Unsqueeze + /encoder/0/layers.0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 495) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 495) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/nonlin_attention/Reshape_1 with /encoder/0/layers.0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/nonlin_attention/Transpose_1 with /encoder/0/layers.0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn1/Reshape with /encoder/0/layers.0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn1/Transpose_1 with /encoder/0/layers.0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 844) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 844) [Shuffle] with /encoder/0/layers.0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn2/Reshape with /encoder/0/layers.0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.0/self_attn2/Transpose_1 with /encoder/0/layers.0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 1046) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 1046) [Shuffle] with /encoder/0/layers.0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn_weights/Reshape_3 with /encoder/0/layers.1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn_weights/Reshape with /encoder/0/layers.1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn_weights/Reshape_2 with /encoder/0/layers.1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn_weights/Reshape_1 with /encoder/0/layers.1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/nonlin_attention/Unsqueeze with /encoder/0/layers.1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/0/layers.1/nonlin_attention/Unsqueeze + /encoder/0/layers.1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/0/layers.1/nonlin_attention/Unsqueeze + /encoder/0/layers.1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 1338) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 1338) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/nonlin_attention/Reshape_1 with /encoder/0/layers.1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/nonlin_attention/Transpose_1 with /encoder/0/layers.1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn1/Reshape with /encoder/0/layers.1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn1/Transpose_1 with /encoder/0/layers.1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 1687) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 1687) [Shuffle] with /encoder/0/layers.1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn2/Reshape with /encoder/0/layers.1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/0/layers.1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/0/layers.1/self_attn2/Transpose_1 with /encoder/0/layers.1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 1889) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 1889) [Shuffle] with /encoder/0/layers.1/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn_weights/Reshape with /encoder/1/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn_weights/Reshape_2 with /encoder/1/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn_weights/Reshape_1 with /encoder/1/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn_weights/Reshape_3 with /encoder/1/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/nonlin_attention/Unsqueeze with /encoder/1/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/1/encoder/0/nonlin_attention/Unsqueeze + /encoder/1/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/1/encoder/0/nonlin_attention/Unsqueeze + /encoder/1/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 2371) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 2371) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/nonlin_attention/Reshape_1 with /encoder/1/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/nonlin_attention/Transpose_1 with /encoder/1/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn1/Reshape with /encoder/1/encoder/0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn1/Transpose_1 with /encoder/1/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 2720) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 2720) [Shuffle] with /encoder/1/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn2/Reshape with /encoder/1/encoder/0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/0/self_attn2/Transpose_1 with /encoder/1/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 2922) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 2922) [Shuffle] with /encoder/1/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn_weights/Reshape_3 with /encoder/1/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn_weights/Reshape with /encoder/1/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn_weights/Reshape_2 with /encoder/1/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn_weights/Reshape_1 with /encoder/1/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/nonlin_attention/Unsqueeze with /encoder/1/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/1/encoder/1/nonlin_attention/Unsqueeze + /encoder/1/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/1/encoder/1/nonlin_attention/Unsqueeze + /encoder/1/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 3214) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 3214) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/nonlin_attention/Reshape_1 with /encoder/1/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/nonlin_attention/Transpose_1 with /encoder/1/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn1/Reshape with /encoder/1/encoder/1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn1/Transpose_1 with /encoder/1/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 3563) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 3563) [Shuffle] with /encoder/1/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn2/Reshape with /encoder/1/encoder/1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/1/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/1/encoder/1/self_attn2/Transpose_1 with /encoder/1/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 3765) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 3765) [Shuffle] with /encoder/1/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn_weights/Reshape with /encoder/2/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn_weights/Reshape_2 with /encoder/2/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn_weights/Reshape_1 with /encoder/2/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn_weights/Reshape_3 with /encoder/2/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/nonlin_attention/Unsqueeze with /encoder/2/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/2/encoder/0/nonlin_attention/Unsqueeze + /encoder/2/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/2/encoder/0/nonlin_attention/Unsqueeze + /encoder/2/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 4323) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 4323) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/nonlin_attention/Reshape_1 with /encoder/2/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/nonlin_attention/Transpose_1 with /encoder/2/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn1/Reshape with /encoder/2/encoder/0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn1/Transpose_1 with /encoder/2/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 4672) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 4672) [Shuffle] with /encoder/2/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn2/Reshape with /encoder/2/encoder/0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/0/self_attn2/Transpose_1 with /encoder/2/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 4874) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 4874) [Shuffle] with /encoder/2/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn_weights/Reshape_3 with /encoder/2/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn_weights/Reshape with /encoder/2/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn_weights/Reshape_2 with /encoder/2/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn_weights/Reshape_1 with /encoder/2/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/nonlin_attention/Unsqueeze with /encoder/2/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/2/encoder/1/nonlin_attention/Unsqueeze + /encoder/2/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/2/encoder/1/nonlin_attention/Unsqueeze + /encoder/2/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 5166) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 5166) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/nonlin_attention/Reshape_1 with /encoder/2/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/nonlin_attention/Transpose_1 with /encoder/2/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn1/Reshape with /encoder/2/encoder/1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn1/Transpose_1 with /encoder/2/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 5515) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 5515) [Shuffle] with /encoder/2/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn2/Reshape with /encoder/2/encoder/1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/1/self_attn2/Transpose_1 with /encoder/2/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 5717) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 5717) [Shuffle] with /encoder/2/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn_weights/Reshape_3 with /encoder/2/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn_weights/Reshape with /encoder/2/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn_weights/Reshape_2 with /encoder/2/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn_weights/Reshape_1 with /encoder/2/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/nonlin_attention/Unsqueeze with /encoder/2/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/2/encoder/2/nonlin_attention/Unsqueeze + /encoder/2/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/2/encoder/2/nonlin_attention/Unsqueeze + /encoder/2/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 6009) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 6009) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/nonlin_attention/Reshape_1 with /encoder/2/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/nonlin_attention/Transpose_1 with /encoder/2/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn1/Reshape with /encoder/2/encoder/2/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn1/Transpose_1 with /encoder/2/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 6358) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 6358) [Shuffle] with /encoder/2/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn2/Reshape with /encoder/2/encoder/2/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/2/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/2/encoder/2/self_attn2/Transpose_1 with /encoder/2/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 6560) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 6560) [Shuffle] with /encoder/2/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn_weights/Reshape with /encoder/3/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn_weights/Reshape_2 with /encoder/3/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn_weights/Reshape_1 with /encoder/3/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn_weights/Reshape_3 with /encoder/3/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/nonlin_attention/Unsqueeze with /encoder/3/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/3/encoder/0/nonlin_attention/Unsqueeze + /encoder/3/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/3/encoder/0/nonlin_attention/Unsqueeze + /encoder/3/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 7118) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 7118) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/nonlin_attention/Reshape_1 with /encoder/3/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/nonlin_attention/Transpose_1 with /encoder/3/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn1/Reshape with /encoder/3/encoder/0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn1/Transpose_1 with /encoder/3/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 7467) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 7467) [Shuffle] with /encoder/3/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn2/Reshape with /encoder/3/encoder/0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/0/self_attn2/Transpose_1 with /encoder/3/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 7669) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 7669) [Shuffle] with /encoder/3/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn_weights/Reshape_3 with /encoder/3/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn_weights/Reshape with /encoder/3/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn_weights/Reshape_2 with /encoder/3/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn_weights/Reshape_1 with /encoder/3/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/nonlin_attention/Unsqueeze with /encoder/3/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/3/encoder/1/nonlin_attention/Unsqueeze + /encoder/3/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/3/encoder/1/nonlin_attention/Unsqueeze + /encoder/3/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 7961) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 7961) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/nonlin_attention/Reshape_1 with /encoder/3/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/nonlin_attention/Transpose_1 with /encoder/3/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn1/Reshape with /encoder/3/encoder/1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn1/Transpose_1 with /encoder/3/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 8310) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 8310) [Shuffle] with /encoder/3/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn2/Reshape with /encoder/3/encoder/1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/1/self_attn2/Transpose_1 with /encoder/3/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 8512) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 8512) [Shuffle] with /encoder/3/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn_weights/Reshape_3 with /encoder/3/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn_weights/Reshape with /encoder/3/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn_weights/Reshape_2 with /encoder/3/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn_weights/Reshape_1 with /encoder/3/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/nonlin_attention/Unsqueeze with /encoder/3/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/3/encoder/2/nonlin_attention/Unsqueeze + /encoder/3/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/3/encoder/2/nonlin_attention/Unsqueeze + /encoder/3/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 8804) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 8804) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/nonlin_attention/Reshape_1 with /encoder/3/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/nonlin_attention/Transpose_1 with /encoder/3/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn1/Reshape with /encoder/3/encoder/2/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn1/Transpose_1 with /encoder/3/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 9153) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 9153) [Shuffle] with /encoder/3/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn2/Reshape with /encoder/3/encoder/2/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/2/self_attn2/Transpose_1 with /encoder/3/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 9355) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 9355) [Shuffle] with /encoder/3/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn_weights/Reshape_3 with /encoder/3/encoder/3/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn_weights/Reshape with /encoder/3/encoder/3/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn_weights/Reshape_2 with /encoder/3/encoder/3/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn_weights/Reshape_1 with /encoder/3/encoder/3/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/nonlin_attention/Unsqueeze with /encoder/3/encoder/3/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/3/encoder/3/nonlin_attention/Unsqueeze + /encoder/3/encoder/3/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/3/encoder/3/nonlin_attention/Unsqueeze + /encoder/3/encoder/3/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 9647) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 9647) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/nonlin_attention/Reshape_1 with /encoder/3/encoder/3/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/nonlin_attention/Transpose_1 with /encoder/3/encoder/3/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn1/Reshape with /encoder/3/encoder/3/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn1/Transpose_1 with /encoder/3/encoder/3/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 9996) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 9996) [Shuffle] with /encoder/3/encoder/3/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn2/Reshape with /encoder/3/encoder/3/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/3/encoder/3/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/3/encoder/3/self_attn2/Transpose_1 with /encoder/3/encoder/3/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 10198) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 10198) [Shuffle] with /encoder/3/encoder/3/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn_weights/Reshape with /encoder/4/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn_weights/Reshape_2 with /encoder/4/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn_weights/Reshape_1 with /encoder/4/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn_weights/Reshape_3 with /encoder/4/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/nonlin_attention/Unsqueeze with /encoder/4/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/4/encoder/0/nonlin_attention/Unsqueeze + /encoder/4/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/4/encoder/0/nonlin_attention/Unsqueeze + /encoder/4/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 10727) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 10727) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/nonlin_attention/Reshape_1 with /encoder/4/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/nonlin_attention/Transpose_1 with /encoder/4/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn1/Reshape with /encoder/4/encoder/0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn1/Transpose_1 with /encoder/4/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 11076) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 11076) [Shuffle] with /encoder/4/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn2/Reshape with /encoder/4/encoder/0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/0/self_attn2/Transpose_1 with /encoder/4/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 11278) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 11278) [Shuffle] with /encoder/4/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn_weights/Reshape_3 with /encoder/4/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn_weights/Reshape with /encoder/4/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn_weights/Reshape_2 with /encoder/4/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn_weights/Reshape_1 with /encoder/4/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/nonlin_attention/Unsqueeze with /encoder/4/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/4/encoder/1/nonlin_attention/Unsqueeze + /encoder/4/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/4/encoder/1/nonlin_attention/Unsqueeze + /encoder/4/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 11570) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 11570) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/nonlin_attention/Reshape_1 with /encoder/4/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/nonlin_attention/Transpose_1 with /encoder/4/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn1/Reshape with /encoder/4/encoder/1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn1/Transpose_1 with /encoder/4/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 11919) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 11919) [Shuffle] with /encoder/4/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn2/Reshape with /encoder/4/encoder/1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/1/self_attn2/Transpose_1 with /encoder/4/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 12121) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 12121) [Shuffle] with /encoder/4/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn_weights/Reshape_3 with /encoder/4/encoder/2/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn_weights/Reshape with /encoder/4/encoder/2/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn_weights/Reshape_2 with /encoder/4/encoder/2/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn_weights/Reshape_1 with /encoder/4/encoder/2/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/nonlin_attention/Unsqueeze with /encoder/4/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/4/encoder/2/nonlin_attention/Unsqueeze + /encoder/4/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/4/encoder/2/nonlin_attention/Unsqueeze + /encoder/4/encoder/2/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 12413) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 12413) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/nonlin_attention/Reshape_1 with /encoder/4/encoder/2/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/nonlin_attention/Transpose_1 with /encoder/4/encoder/2/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn1/Reshape with /encoder/4/encoder/2/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn1/Transpose_1 with /encoder/4/encoder/2/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 12762) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 12762) [Shuffle] with /encoder/4/encoder/2/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn2/Reshape with /encoder/4/encoder/2/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/4/encoder/2/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/4/encoder/2/self_attn2/Transpose_1 with /encoder/4/encoder/2/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 12964) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 12964) [Shuffle] with /encoder/4/encoder/2/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn_weights/Reshape with /encoder/5/encoder/0/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn_weights/Reshape_2 with /encoder/5/encoder/0/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn_weights/Reshape_1 with /encoder/5/encoder/0/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn_weights/Reshape_3 with /encoder/5/encoder/0/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/nonlin_attention/Unsqueeze with /encoder/5/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/5/encoder/0/nonlin_attention/Unsqueeze + /encoder/5/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/5/encoder/0/nonlin_attention/Unsqueeze + /encoder/5/encoder/0/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 13493) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 13493) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/nonlin_attention/Reshape_1 with /encoder/5/encoder/0/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/nonlin_attention/Transpose_1 with /encoder/5/encoder/0/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn1/Reshape with /encoder/5/encoder/0/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn1/Transpose_1 with /encoder/5/encoder/0/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 13842) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 13842) [Shuffle] with /encoder/5/encoder/0/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn2/Reshape with /encoder/5/encoder/0/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/0/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/0/self_attn2/Transpose_1 with /encoder/5/encoder/0/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 14044) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 14044) [Shuffle] with /encoder/5/encoder/0/conv_module2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn_weights/Reshape_3 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn_weights/Reshape_3 with /encoder/5/encoder/1/self_attn_weights/Transpose_3 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn_weights/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn_weights/Reshape with /encoder/5/encoder/1/self_attn_weights/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn_weights/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn_weights/Reshape_2 with /encoder/5/encoder/1/self_attn_weights/Transpose_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn_weights/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn_weights/Reshape_1 with /encoder/5/encoder/1/self_attn_weights/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/nonlin_attention/Unsqueeze [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/nonlin_attention/Unsqueeze with /encoder/5/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on /encoder/5/encoder/1/nonlin_attention/Unsqueeze + /encoder/5/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Removing /encoder/5/encoder/1/nonlin_attention/Unsqueeze + /encoder/5/encoder/1/nonlin_attention/Reshape [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleErasure on (Unnamed Layer* 14336) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Removing (Unnamed Layer* 14336) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/nonlin_attention/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/nonlin_attention/Reshape_1 with /encoder/5/encoder/1/nonlin_attention/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/nonlin_attention/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/nonlin_attention/Transpose_1 with /encoder/5/encoder/1/nonlin_attention/Reshape_2 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn1/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn1/Reshape with /encoder/5/encoder/1/self_attn1/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn1/Transpose_1 with /encoder/5/encoder/1/self_attn1/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 14685) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 14685) [Shuffle] with /encoder/5/encoder/1/conv_module1/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn2/Reshape [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn2/Reshape with /encoder/5/encoder/1/self_attn2/Transpose [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on /encoder/5/encoder/1/self_attn2/Transpose_1 [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing /encoder/5/encoder/1/self_attn2/Transpose_1 with /encoder/5/encoder/1/self_attn2/Reshape_1 [07/20/2023-07:25:32] [V] [TRT] Running: ShuffleShuffleFusion on (Unnamed Layer* 14887) [Shuffle] [07/20/2023-07:25:32] [V] [TRT] ShuffleShuffleFusion: Fusing (Unnamed Layer* 14887) [Shuffle] with /encoder/5/encoder/1/conv_module2/Transpose_1 [07/20/2023-07:25:33] [V] [TRT] After Myelin optimization: 154 layers [07/20/2023-07:25:33] [V] [TRT] Applying ScaleNodes fusions. [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] with /encoder_embed/conv/3/Mul [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] with /encoder_embed/conv/3/Add [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] with /encoder_embed/conv/6/Mul [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] with /encoder_embed/conv/6/Add [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] with /encoder_embed/conv/9/Mul [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] with /encoder_embed/conv/9/Add [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] with /encoder_embed/convnext/activation/Mul [07/20/2023-07:25:33] [V] [TRT] Running: ConstEltFusion on /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] ConstEltFusion: Fusing /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] with /encoder_embed/convnext/activation/Add [07/20/2023-07:25:33] [V] [TRT] After scale fusion: 146 layers [07/20/2023-07:25:33] [V] [TRT] Running: CastToCopyTransform on /encoder_embed/Cast [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/Cast from CAST to CAST [07/20/2023-07:25:33] [V] [TRT] Running: CastToCopyTransform on /encoder_embed/Cast_1 [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/Cast_1 from CAST to CAST [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/3/Abs [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/3/Abs from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/3/Neg [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/3/Neg from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/3/Exp [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/3/Exp from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/3/Log [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/3/Log from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/6/Abs [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/6/Abs from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/6/Neg [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/6/Neg from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/6/Exp [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/6/Exp from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/6/Log [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/6/Log from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/9/Abs [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/9/Abs from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/9/Neg [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/9/Neg from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/9/Exp [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/9/Exp from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/conv/9/Log [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/conv/9/Log from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/convnext/activation/Abs [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/convnext/activation/Abs from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/convnext/activation/Neg [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/convnext/activation/Neg from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/convnext/activation/Exp [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/convnext/activation/Exp from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] Running: UnaryToPointwiseConversion on /encoder_embed/convnext/activation/Log [07/20/2023-07:25:33] [V] [TRT] Swap the layer type of /encoder_embed/convnext/activation/Log from UNARY to POINTWISE [07/20/2023-07:25:33] [V] [TRT] After dupe layer removal: 146 layers [07/20/2023-07:25:33] [V] [TRT] After final dead-layer removal: 146 layers [07/20/2023-07:25:33] [V] [TRT] After tensor merging: 146 layers [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle] with /encoder_embed/conv/3/Sub_3 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul with /encoder_embed/conv/3/Sub_2 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle] with /encoder_embed/conv/3/Max [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle] with /encoder_embed/conv/3/Sub [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max) with /encoder_embed/conv/3/Add_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle] with /encoder_embed/conv/3/Sub_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1) with PWN(/encoder_embed/conv/3/Abs) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)) with PWN(/encoder_embed/conv/3/Neg) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)) with PWN(/encoder_embed/conv/3/Exp) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)) with /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add) with PWN(/encoder_embed/conv/3/Log) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)) with PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)) with PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)) with PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle] with /encoder_embed/conv/6/Sub_3 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul with /encoder_embed/conv/6/Sub_2 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle] with /encoder_embed/conv/6/Max [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle] with /encoder_embed/conv/6/Sub [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max) with /encoder_embed/conv/6/Add_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle] with /encoder_embed/conv/6/Sub_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1) with PWN(/encoder_embed/conv/6/Abs) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)) with PWN(/encoder_embed/conv/6/Neg) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)) with PWN(/encoder_embed/conv/6/Exp) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)) with /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add) with PWN(/encoder_embed/conv/6/Log) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)) with PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)) with PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)) with PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle] with /encoder_embed/conv/9/Sub_3 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul with /encoder_embed/conv/9/Sub_2 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle] with /encoder_embed/conv/9/Max [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle] with /encoder_embed/conv/9/Sub [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max) with /encoder_embed/conv/9/Add_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle] with /encoder_embed/conv/9/Sub_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1) with PWN(/encoder_embed/conv/9/Abs) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)) with PWN(/encoder_embed/conv/9/Neg) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)) with PWN(/encoder_embed/conv/9/Exp) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)) with /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add) with PWN(/encoder_embed/conv/9/Log) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)) with PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)) with PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)) with PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle] with /encoder_embed/convnext/activation/Sub_3 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul with /encoder_embed/convnext/activation/Sub_2 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle] with /encoder_embed/convnext/activation/Max [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle] with /encoder_embed/convnext/activation/Sub [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max) with /encoder_embed/convnext/activation/Add_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on /encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle] [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing /encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle] with /encoder_embed/convnext/activation/Sub_1 [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1) with PWN(/encoder_embed/convnext/activation/Abs) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)) with PWN(/encoder_embed/convnext/activation/Neg) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)) with PWN(/encoder_embed/convnext/activation/Exp) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)) with /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add) with PWN(/encoder_embed/convnext/activation/Log) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)) with PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)) with PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)) with PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub) with PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3)) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub) with PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3)) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub) with PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3)) [07/20/2023-07:25:33] [V] [TRT] Running: PointWiseFusion on PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub) [07/20/2023-07:25:33] [V] [TRT] PointWiseFusion: Fusing PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub) with PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3)) [07/20/2023-07:25:33] [V] [TRT] Running: GenericConvActFusion on /encoder_embed/conv/4/Conv [07/20/2023-07:25:33] [V] [TRT] GenericConvActFusion: Fusing /encoder_embed/conv/4/Conv with PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) [07/20/2023-07:25:33] [V] [TRT] Running: GenericConvActFusion on /encoder_embed/conv/7/Conv [07/20/2023-07:25:33] [V] [TRT] GenericConvActFusion: Fusing /encoder_embed/conv/7/Conv with PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) [07/20/2023-07:25:33] [V] [TRT] Running: GenericConvActFusion on /encoder_embed/convnext/pointwise_conv1/Conv [07/20/2023-07:25:33] [V] [TRT] GenericConvActFusion: Fusing /encoder_embed/convnext/pointwise_conv1/Conv with PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 840) [Convolution]_outputshuffle nodes around /encoder/0/layers.0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 1041) [Shuffle]_output_and_/encoder/0/layers.0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 1042) [Convolution]_outputshuffle nodes around /encoder/0/layers.0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 1682) [Shuffle]_output_and_/encoder/0/layers.1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 1683) [Convolution]_outputshuffle nodes around /encoder/0/layers.1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 1884) [Shuffle]_output_and_/encoder/0/layers.1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 1885) [Convolution]_outputshuffle nodes around /encoder/0/layers.1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 2716) [Convolution]_outputshuffle nodes around /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 2917) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 2918) [Convolution]_outputshuffle nodes around /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 3558) [Shuffle]_output_and_/encoder/1/encoder/1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 3559) [Convolution]_outputshuffle nodes around /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 3760) [Shuffle]_output_and_/encoder/1/encoder/1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 3761) [Convolution]_outputshuffle nodes around /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 4668) [Convolution]_outputshuffle nodes around /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 4870) [Convolution]_outputshuffle nodes around /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 5510) [Shuffle]_output_and_/encoder/2/encoder/1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 5511) [Convolution]_outputshuffle nodes around /encoder/2/encoder/1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 5712) [Shuffle]_output_and_/encoder/2/encoder/1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 5713) [Convolution]_outputshuffle nodes around /encoder/2/encoder/1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 6353) [Shuffle]_output_and_/encoder/2/encoder/2/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 6354) [Convolution]_outputshuffle nodes around /encoder/2/encoder/2/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 6555) [Shuffle]_output_and_/encoder/2/encoder/2/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 6556) [Convolution]_outputshuffle nodes around /encoder/2/encoder/2/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 7462) [Shuffle]_output_and_/encoder/3/encoder/0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 7463) [Convolution]_outputshuffle nodes around /encoder/3/encoder/0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 7664) [Shuffle]_output_and_/encoder/3/encoder/0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 7665) [Convolution]_outputshuffle nodes around /encoder/3/encoder/0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 8305) [Shuffle]_output_and_/encoder/3/encoder/1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 8306) [Convolution]_outputshuffle nodes around /encoder/3/encoder/1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 8507) [Shuffle]_output_and_/encoder/3/encoder/1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 8508) [Convolution]_outputshuffle nodes around /encoder/3/encoder/1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 9148) [Shuffle]_output_and_/encoder/3/encoder/2/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 9149) [Convolution]_outputshuffle nodes around /encoder/3/encoder/2/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 9350) [Shuffle]_output_and_/encoder/3/encoder/2/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 9351) [Convolution]_outputshuffle nodes around /encoder/3/encoder/2/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 9991) [Shuffle]_output_and_/encoder/3/encoder/3/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 9992) [Convolution]_outputshuffle nodes around /encoder/3/encoder/3/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 10193) [Shuffle]_output_and_/encoder/3/encoder/3/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 10194) [Convolution]_outputshuffle nodes around /encoder/3/encoder/3/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 11071) [Shuffle]_output_and_/encoder/4/encoder/0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 11072) [Convolution]_outputshuffle nodes around /encoder/4/encoder/0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 11273) [Shuffle]_output_and_/encoder/4/encoder/0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 11274) [Convolution]_outputshuffle nodes around /encoder/4/encoder/0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 11914) [Shuffle]_output_and_/encoder/4/encoder/1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 11915) [Convolution]_outputshuffle nodes around /encoder/4/encoder/1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 12116) [Shuffle]_output_and_/encoder/4/encoder/1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 12117) [Convolution]_outputshuffle nodes around /encoder/4/encoder/1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 12757) [Shuffle]_output_and_/encoder/4/encoder/2/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 12758) [Convolution]_outputshuffle nodes around /encoder/4/encoder/2/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 12959) [Shuffle]_output_and_/encoder/4/encoder/2/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 12960) [Convolution]_outputshuffle nodes around /encoder/4/encoder/2/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 13837) [Shuffle]_output_and_/encoder/5/encoder/0/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 13838) [Convolution]_outputshuffle nodes around /encoder/5/encoder/0/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 14039) [Shuffle]_output_and_/encoder/5/encoder/0/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 14040) [Convolution]_outputshuffle nodes around /encoder/5/encoder/0/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 14680) [Shuffle]_output_and_/encoder/5/encoder/1/conv_module1/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 14681) [Convolution]_outputshuffle nodes around /encoder/5/encoder/1/conv_module1/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] Running: Conv1DOptimization on /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:25:33] [V] [TRT] Insert shuffle_between_(Unnamed Layer* 14882) [Shuffle]_output_and_/encoder/5/encoder/1/conv_module2/depthwise_conv/Conv and shuffle_after_(Unnamed Layer* 14883) [Convolution]_outputshuffle nodes around /encoder/5/encoder/1/conv_module2/depthwise_conv/Conv to transpose convolution node. [07/20/2023-07:25:33] [V] [TRT] After vertical fusions: 147 layers [07/20/2023-07:25:33] [V] [TRT] After dupe layer removal: 147 layers [07/20/2023-07:25:33] [V] [TRT] After final dead-layer removal: 147 layers [07/20/2023-07:25:33] [V] [TRT] After tensor merging: 147 layers [07/20/2023-07:25:33] [V] [TRT] After slice removal: 147 layers [07/20/2023-07:25:33] [V] [TRT] After concat removal: 147 layers [07/20/2023-07:25:33] [V] [TRT] Trying to split Reshape and strided tensor [07/20/2023-07:25:33] [I] [TRT] Graph optimization time: 1.38508 seconds. [07/20/2023-07:25:33] [V] [TRT] Building graph using backend strategy 2 [07/20/2023-07:25:33] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [07/20/2023-07:25:33] [V] [TRT] Constructing optimization profile number 0 [1/1]. [07/20/2023-07:25:33] [V] [TRT] Applying generic optimizations to the graph for inference. [07/20/2023-07:25:33] [V] [TRT] Reserving memory for host IO tensors. Host: 0 bytes [07/20/2023-07:25:33] [V] [TRT] =============== Computing costs for [trainStation1] [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: -> *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: [trainStation1] (TrainStation[0x80000032]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.000375324 [07/20/2023-07:25:33] [V] [TRT] [trainStation1] (TrainStation[0x80000032]) profiling completed in 0.0122709 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.000375324 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TrainStation Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] =============== Computing costs for (Unnamed Layer* 15189) [Shuffle]_output[Constant] [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [07/20/2023-07:25:33] [V] [TRT] =============== Computing costs for (Unnamed Layer* 150) [Shuffle]_output[Constant] [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [07/20/2023-07:25:33] [V] [TRT] =============== Computing costs for /encoder_embed/Unsqueeze [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float((* 80 T),80,1) -> Float(E0,E0,80,1) where E0=(* 80 T) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468911 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0223993 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.0130565 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00468911 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float((* 80 T),80,1) -> Float((* 80 T),1:4,80,1) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0178143 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00682745 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0178143 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float(1,(* 80 N),N) -> Float((* 80 T),1,80,1) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044239 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0254293 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00402821 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0044239 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float(1:4,(* 80 E0),E0) where E0=(CEIL_DIV N 4) -> Float(E0,E0,80,1) where E0=(* 80 T) where E0=(CEIL_DIV N 4) E1=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00451771 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00227596 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00451771 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float(1:4,(* 80 E0),E0) where E0=(CEIL_DIV N 4) -> Float((* 80 T),1:4,80,1) where E0=(CEIL_DIV N 4) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0181211 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0265699 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00400159 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0181211 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Float((* 80 T):32,80,1) -> Float(E0,E0:32,80,1) where E0=(* 80 T) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.863643 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0863086 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.0104599 seconds. Fastest Tactic: 0x0000000000000001 Time: 0.0863086 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),80,1) -> Half(E0,E0,80,1) where E0=(* 80 T) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00456 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0292084 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00463625 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00456 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),80,1) -> Half((* 80 T),1:2,80,1) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00555358 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00312574 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00555358 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),80,1) -> Half((* 80 T),1:8,80,1) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0194937 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00205119 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0194937 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half((* 80 T):2,80,1) -> Half(E0,E0:2,80,1) where E0=(* 80 T) where E0=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00577536 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0355109 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.0049156 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00577536 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half(1:2,(* 80 E0),E0) where E0=(CEIL_DIV N 2) -> Half(E0,E0,80,1) where E0=(* 80 T) where E0=(CEIL_DIV N 2) E1=(* 80 T) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00517469 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00275251 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00517469 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half(1:2,(* 80 E0),E0) where E0=(CEIL_DIV N 2) -> Half((* 80 T),1:2,80,1) where E0=(CEIL_DIV N 2) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00515657 [07/20/2023-07:25:33] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0291109 [07/20/2023-07:25:33] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00434121 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00515657 [07/20/2023-07:25:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:33] [V] [TRT] *************** Autotuning format combination: Half(1:4,(* 80 E0),E0) where E0=(CEIL_DIV N 4) -> Half((* 80 T),1:4,80,1) where E0=(CEIL_DIV N 4) *************** [07/20/2023-07:25:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00744091 [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0285257 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00429859 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00744091 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half(1:8,(* 80 E0),E0) where E0=(CEIL_DIV N 8) -> Half(E0,E0,80,1) where E0=(* 80 T) where E0=(CEIL_DIV N 8) E1=(* 80 T) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00462024 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00269593 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00462024 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half(1:8,(* 80 E0),E0) where E0=(CEIL_DIV N 8) -> Half((* 80 T),1:8,80,1) where E0=(CEIL_DIV N 8) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0197486 [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0320951 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00399783 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0197486 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half(1:16,(* 80 E0),E0) where E0=(CEIL_DIV N 16) -> Half((* 80 T),1:16,80,1) where E0=(CEIL_DIV N 16) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.100937 [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0377349 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Unsqueeze (Shuffle[0x8000000d]) profiling completed in 0.00396082 seconds. Fastest Tactic: 0x0000000000000001 Time: 0.0377349 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000001 [07/20/2023-07:25:34] [V] [TRT] =============== Computing costs for [ShapeHostToDeviceCopy 0] [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: -> Int32() *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: [ShapeHostToDeviceCopy 0] (ShapeHostToDevice[0x80000024]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00400952 [07/20/2023-07:25:34] [V] [TRT] [ShapeHostToDeviceCopy 0] (ShapeHostToDevice[0x80000024]) profiling completed in 0.00235393 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00400952 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ShapeHostToDevice Tactic: 0x0000000000000000 [07/20/2023-07:25:34] [V] [TRT] =============== Computing costs for /encoder_embed/Sub [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Int32(1), Int32(1) -> Int32(1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/Sub (ElementWise[0x80000003]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00400902 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Sub (ElementWise[0x80000003]) profiling completed in 0.00483644 seconds. Fastest Tactic: 0x0000000000000001 Time: 0.00400902 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/20/2023-07:25:34] [V] [TRT] =============== Computing costs for /encoder_embed/conv/0/Conv [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Float(E0,E0,80,1) where E0=(* 80 T) -> Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) where E0=(* 80 T) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 0.103568 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 0.0589531 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 0.0520777 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 0.103131 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0xede36641840ce3d2 Time: 0.0633417 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 0.0542232 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x1673e3594ce11cea Time: 0.0610621 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 0.0558811 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 0.110373 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x7fc93550f5b9c127 Time: 0.0539703 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 0.0409749 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 Time: 0.110302 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 0.0510415 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 0.0791406 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x31aa67f57c5aea77 Time: 0.0576853 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 0.0316315 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c Time: 0.101083 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 Time: 0.0688518 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x94119b4c514b211a Time: 0.0707048 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 0.028416 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 0.053248 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0xe640ceafd7d34ca9 Time: 0.0521265 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 0.0619276 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x8ad32616b1424be4 Time: 0.0490926 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x3712e3e595645874 Time: 0.0478339 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 0.0729371 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 0.103717 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.234805 seconds. Fastest Tactic: 0xa8609adc4e0ceb90 Time: 0.028416 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:25:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa8609adc4e0ceb90 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Float((* 80 T),1,80,1) -> Float((MUL_ADD 640 T -1280),1,640,8) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 Time: 0.424082 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 0.136631 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 0.0190034 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee Time: 0.129022 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 0.0526141 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x5953bec563d26434 Time: 0.0827977 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 0.127781 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 0.133632 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 0.0578423 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x32059de4888dfdda Time: 0.0482743 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 0.0174811 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 0.0876251 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 Time: 0.244297 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 0.0961097 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 0.128512 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 0.0813349 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 Time: 0.124633 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0595831 seconds. Fastest Tactic: 0xf231cca3335919a4 Time: 0.0174811 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf231cca3335919a4 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Float((* 80 T),1:4,80,1) -> Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x9787b83bedcff6a2 Time: 0.173349 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0xe8f7b6a5bab325f8 Time: 0.200997 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0x9fd9fe001908ce2e Time: 0.196315 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xe0a307ffe0ffb6a5 Time: 0.178761 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3_alignc4 Tactic: 0x1323e48791e2f671 Time: 0.185344 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x3104d85fecdd547c Time: 0.173934 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0200149 seconds. Fastest Tactic: 0x9787b83bedcff6a2 Time: 0.173349 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9787b83bedcff6a2 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Float((* 80 T),1:4,80,1) -> Float((MUL_ADD 160 T -320),1:4,160,2) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d Time: 0.0265996 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 Time: 0.0365714 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 Time: 0.0294619 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 Time: 0.0291995 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 Time: 0.0296128 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 Time: 0.0244297 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 Time: 0.0319781 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 Time: 0.0259147 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 Time: 0.0259901 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba Time: 0.0269707 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef Time: 0.0261676 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 Time: 0.0260686 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 Time: 0.0336768 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b Time: 0.0508587 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b Time: 0.179493 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 Time: 0.0240053 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 Time: 0.0325925 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 Time: 0.024771 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 Time: 0.0267703 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde Time: 0.0237192 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 Time: 0.0329143 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 Time: 0.028789 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 Time: 0.0319973 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 Time: 0.0329253 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 Time: 0.178322 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 Time: 0.184027 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 Time: 0.0330944 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 Time: 0.0243779 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 Time: 0.0349687 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd Time: 0.0240396 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.073431 seconds. Fastest Tactic: 0x10383a0781d24dde Time: 0.0237192 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x10383a0781d24dde [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half(E0,E0,80,1) where E0=(* 80 T) -> Half((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) where E0=(* 80 T) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:25:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),1:2,80,1) -> Half((MUL_ADD 320 T -640),1:2,320,4) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.0325257 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.0195874 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.0325339 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0157989 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.0155278 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.0212114 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0156256 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0204565 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.0114208 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0156567 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.0236186 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0212571 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.0161402 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.0244076 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.0145115 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0110699 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0377364 seconds. Fastest Tactic: 0x1fb62367b99fe633 Time: 0.0110699 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1fb62367b99fe633 [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),1:4,80,1) -> Half((MUL_ADD 160 T -320),1:4,160,2) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),1:4,80,1) -> Half((MUL_ADD 80 T -160),1:8,80,1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x9d562342491490bf Time: 0.012485 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x280b0ad3c23d8442 Time: 0.0159751 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.0334491 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x1498693488a7556d Time: 0.0159126 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.0253318 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xdf2bb9dcbfb149ec Time: 0.0247223 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0xfb0beb2dd64ff6e8 Time: 0.0158776 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.0331767 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x2b2ebb8d9563987f Time: 0.0178494 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0164302 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.0242613 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.0270385 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0xfeb4e5d6176dd16f Time: 0.0172277 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0186149 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0210442 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0xa47a4e5ec2ac6617 Time: 0.0159076 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x112767cf498572ea Time: 0.0128103 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.0157989 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x1a092d9c78bdc1b4 Time: 0.0131657 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0160914 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x3507353e207bcdee Time: 0.0251886 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x1202d6911edb6ed7 Time: 0.0130194 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0xf82e5a738111ead5 Time: 0.0178143 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xe607d4c03409bf44 Time: 0.0314222 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.0244541 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0217972 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x93c767eab90e0466 Time: 0.0153582 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x5874b7028e1818e7 Time: 0.0239459 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x96786911782c23e1 Time: 0.0132704 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.0248686 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.0253074 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x777aafa0d6de14bd Time: 0.0165125 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.0176193 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0154039 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x955dd84f2f723fdc Time: 0.0134849 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x2db40428031fa3c5 Time: 0.0201411 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0831655 seconds. Fastest Tactic: 0x9d562342491490bf Time: 0.012485 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9d562342491490bf [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),1:8,80,1) -> Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Half((* 80 T),1:8,80,1) -> Half((MUL_ADD 80 T -160),1:8,80,1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xdce100b9fe609424 Time: 0.058557 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3 Tactic: 0xa9177bbe4e767df8 Time: 0.268873 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x9d562342491490bf Time: 0.0182634 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x18d13b6b3c8edcbe Time: 0.0241615 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0xfbf5ea2d8a6293cd Time: 0.0158139 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x280b0ad3c23d8442 Time: 0.0239177 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.0584792 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x05b6220f243edacd Time: 0.143945 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x1498693488a7556d Time: 0.0248503 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0x60da8c7151d91e47 Time: 0.139045 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0xf8d05b73dd3c8ff0 Time: 0.0159081 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.0369737 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xdf2bb9dcbfb149ec Time: 0.0431909 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0xfb0beb2dd64ff6e8 Time: 0.0216503 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.0561371 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x2b2ebb8d9563987f Time: 0.0259901 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x9785ceb86b4122d6 Time: 0.0226534 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0250354 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.0339657 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.038656 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0xfeb4e5d6176dd16f Time: 0.0241615 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0250392 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xdfa020ef435ef810 Time: 0.153307 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0332069 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0xa47a4e5ec2ac6617 Time: 0.0236376 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x5568fd8a32f4a40f Time: 0.148334 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0xc0a02dc6095497cc Time: 0.255707 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0xb4bec086187edcfc Time: 0.0929646 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x57c9a5ff682354a6 Time: 0.257024 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x112767cf498572ea Time: 0.0186503 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0xa5a46bfbd719d757 Time: 0.0170347 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.0207092 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xdb0b80f591d1bb6d Time: 0.177006 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x31d93dc22d2af081 Time: 0.182857 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x5820b3dda403c4d0 Time: 0.143506 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x1a092d9c78bdc1b4 Time: 0.0170199 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0252343 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x3507353e207bcdee Time: 0.037712 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0xb17d53d15dfbfc9e Time: 0.13963 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x21b295c0c8f6c95a Time: 0.145701 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xe1ff5ad20f5c6bf6 Time: 0.160475 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x2af09e2880d6293f Time: 0.0182691 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x1202d6911edb6ed7 Time: 0.0187794 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xbd08239a9317f2fd Time: 0.0964023 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x0866ddee325d07a6 Time: 0.0879909 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa570c55d303796ff Time: 0.0803109 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x4a81ea1e51436a30 Time: 0.191049 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x0e07ff4f4f7c1ac9 Time: 0.162085 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0xf82e5a738111ead5 Time: 0.023215 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xc9d24bd069159fa8 Time: 0.108107 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x1bf48a356bd0c083 Time: 0.0216255 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xe607d4c03409bf44 Time: 0.0541851 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x263a38afd75e3a43 Time: 0.183589 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.0424229 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x60c3421152ef8e10 Time: 0.149211 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0335845 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0xa1a20ea714d420f4 Time: 0.270629 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x29d52f76d7883502 Time: 0.0168879 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xf79479a62ea9f901 Time: 0.0568564 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x7784aea08af37198 Time: 0.0157275 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x93c767eab90e0466 Time: 0.0201914 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa83b68f30462f971 Time: 0.0556373 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x5874b7028e1818e7 Time: 0.0338505 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0x834e11ecd4ab9454 Time: 0.0551985 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x96786911782c23e1 Time: 0.0170804 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0x7005d10718f6c22d Time: 0.27136 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xd1aaad17ca35fbaa Time: 0.0807611 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x245530c34bd6090f Time: 0.156672 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.0345225 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.043008 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16_aACCESS Tactic: 0x841c601dec2a75bc Time: 0.200997 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x30e8a8d7a953e5e9 Time: 0.222793 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x048d6d0400f33439 Time: 0.137289 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x777aafa0d6de14bd Time: 0.0219677 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.023987 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xafd1e8bf6bd3d638 Time: 0.1792 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xf35e0311fa1cc516 Time: 0.170862 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x529f4431bdae94f5 Time: 0.0792137 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 0xa40cb43c296a36a8 Time: 0.0576366 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x3e7eb35b91b9fa63 Time: 0.0539749 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0201874 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x955dd84f2f723fdc Time: 0.0169529 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16 Tactic: 0x7273dde1d0cd3bd5 Time: 0.152137 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x2db40428031fa3c5 Time: 0.0321243 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0x17ebf0c9f418f10a Time: 0.169106 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3 Tactic: 0xa033e20ae9f412b2 Time: 0.131511 [07/20/2023-07:25:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x866e7a5f6401b67f Time: 0.257609 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/conv/0/Conv (CaskConvolution[0x80000009]) profiling completed in 0.237511 seconds. Fastest Tactic: 0x7784aea08af37198 Time: 0.0157275 [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/0/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:25:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7784aea08af37198 [07/20/2023-07:25:34] [V] [TRT] =============== Computing costs for /encoder_embed/Div [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Int32(1), Int32(1) -> Int32(1) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/Div (ElementWise[0x80000003]) [07/20/2023-07:25:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00487147 [07/20/2023-07:25:34] [V] [TRT] /encoder_embed/Div (ElementWise[0x80000003]) profiling completed in 0.00253739 seconds. Fastest Tactic: 0x0000000000000001 Time: 0.00487147 [07/20/2023-07:25:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/20/2023-07:25:34] [V] [TRT] =============== Computing costs for PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) [07/20/2023-07:25:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) -> Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) where E0=(MUL_ADD 80 T -160) E1=(MUL_ADD 640 T -1280) *************** [07/20/2023-07:25:34] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:35] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221884 [07/20/2023-07:25:35] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0256975 [07/20/2023-07:25:35] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0236774 [07/20/2023-07:25:36] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0253806 [07/20/2023-07:25:36] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0241615 [07/20/2023-07:25:36] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0232007 [07/20/2023-07:25:37] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0264533 [07/20/2023-07:25:37] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0248198 [07/20/2023-07:25:37] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0244297 [07/20/2023-07:25:37] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0238225 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0221989 [07/20/2023-07:25:38] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 3.26475 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0221884 [07/20/2023-07:25:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000000 [07/20/2023-07:25:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 640 T -1280),1,640,8) -> Float((MUL_ADD 640 T -1280),1,640,8) where E0=(MUL_ADD 640 T -1280) *************** [07/20/2023-07:25:38] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0221845 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0257943 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0234893 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0254994 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0240396 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0233254 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0264198 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0249455 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0244297 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0238438 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0221675 [07/20/2023-07:25:38] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 0.0444474 seconds. Fastest Tactic: 0x000000000000001c Time: 0.0221675 [07/20/2023-07:25:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [07/20/2023-07:25:38] [V] [TRT] *************** Autotuning format combination: Float(1,(* (+ T -2) E0),E0,N) where E0=(* 80 N) -> Float(1,(* (+ T -2) E0),E0,N) where E0=(* 80 N) where E0=(* 80 N) E1=(* (+ T -2) E0) *************** [07/20/2023-07:25:38] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.022319 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0258194 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0235938 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0253813 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.0240869 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0232601 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0263802 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0247992 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0245029 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0237767 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0222302 [07/20/2023-07:25:38] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 0.0563393 seconds. Fastest Tactic: 0x000000000000001c Time: 0.0222302 [07/20/2023-07:25:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [07/20/2023-07:25:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 160 T -320),1:4,160,2) -> Float((MUL_ADD 160 T -320),1:4,160,2) where E0=(MUL_ADD 160 T -320) *************** [07/20/2023-07:25:38] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0229042 [07/20/2023-07:25:38] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0244053 [07/20/2023-07:25:39] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.0234207 [07/20/2023-07:25:39] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.0243581 [07/20/2023-07:25:39] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.023281 [07/20/2023-07:25:40] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.0205636 [07/20/2023-07:25:40] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0248442 [07/20/2023-07:25:40] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.0242057 [07/20/2023-07:25:41] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.0237995 [07/20/2023-07:25:41] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0206263 [07/20/2023-07:25:41] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0235324 [07/20/2023-07:25:42] [V] [TRT] Tactic: 0x000000000000000b Time: 0.0240152 [07/20/2023-07:25:42] [V] [TRT] Tactic: 0x000000000000000c Time: 0.0232803 [07/20/2023-07:25:42] [V] [TRT] Tactic: 0x000000000000000d Time: 0.0249638 [07/20/2023-07:25:43] [V] [TRT] Tactic: 0x000000000000000e Time: 0.0243688 [07/20/2023-07:25:43] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0237179 [07/20/2023-07:25:43] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.0249029 [07/20/2023-07:25:43] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.0243771 [07/20/2023-07:25:44] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.0232895 [07/20/2023-07:25:44] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.020623 [07/20/2023-07:25:45] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.0224653 [07/20/2023-07:25:45] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.025728 [07/20/2023-07:25:45] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.0255505 [07/20/2023-07:25:45] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.0264526 [07/20/2023-07:25:46] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0229257 [07/20/2023-07:25:46] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0235148 [07/20/2023-07:25:46] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0223412 [07/20/2023-07:25:46] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 8.41058 seconds. Fastest Tactic: 0x0000000000000005 Time: 0.0205636 [07/20/2023-07:25:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [07/20/2023-07:25:46] [V] [TRT] *************** Autotuning format combination: Float(E0,E0:32,80,1) where E0=(MUL_ADD 80 T -160) -> Float(E0,E0:32,80,1) where E0=(MUL_ADD 80 T -160) where E0=(MUL_ADD 80 T -160) *************** [07/20/2023-07:25:46] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:47] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.0884229 [07/20/2023-07:25:47] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.0910629 [07/20/2023-07:25:47] [V] [TRT] Tactic: 0x000000000000001a Time: 0.0918674 [07/20/2023-07:25:48] [V] [TRT] Tactic: 0x000000000000001b Time: 0.0917943 [07/20/2023-07:25:48] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0883566 [07/20/2023-07:25:48] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 1.58615 seconds. Fastest Tactic: 0x000000000000001f Time: 0.0883566 [07/20/2023-07:25:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001f [07/20/2023-07:25:48] [V] [TRT] *************** Autotuning format combination: Float(1:4,(* (+ T -2) E1),E1,E0) where E0=(CEIL_DIV N 4) E1=(* 80 E0) -> Float(1:4,(* (+ T -2) E1),E1,E0) where E0=(CEIL_DIV N 4) E1=(* 80 E0) where E0=(CEIL_DIV N 4) E1=(* 80 E0) E2=(* (+ T -2) E1) *************** [07/20/2023-07:25:48] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.123685 [07/20/2023-07:25:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.163694 [07/20/2023-07:25:49] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.142482 [07/20/2023-07:25:49] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.193097 [07/20/2023-07:25:49] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.181394 [07/20/2023-07:25:50] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.148773 [07/20/2023-07:25:50] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.261998 [07/20/2023-07:25:50] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.234016 [07/20/2023-07:25:51] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.208603 [07/20/2023-07:25:51] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.213723 [07/20/2023-07:25:52] [V] [TRT] Tactic: 0x000000000000000a Time: 0.116898 [07/20/2023-07:25:52] [V] [TRT] Tactic: 0x000000000000000b Time: 0.146871 [07/20/2023-07:25:52] [V] [TRT] Tactic: 0x000000000000000c Time: 0.120686 [07/20/2023-07:25:53] [V] [TRT] Tactic: 0x000000000000000d Time: 0.175104 [07/20/2023-07:25:53] [V] [TRT] Tactic: 0x000000000000000e Time: 0.153746 [07/20/2023-07:25:53] [V] [TRT] Tactic: 0x000000000000000f Time: 0.125513 [07/20/2023-07:25:53] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.242981 [07/20/2023-07:25:54] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.199826 [07/20/2023-07:25:54] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.166912 [07/20/2023-07:25:55] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.147895 [07/20/2023-07:25:55] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.102983 [07/20/2023-07:25:55] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.126382 [07/20/2023-07:25:55] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.142409 [07/20/2023-07:25:56] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.189733 [07/20/2023-07:25:56] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0230446 [07/20/2023-07:25:56] [V] [TRT] Tactic: 0x000000000000001d Time: 0.023761 [07/20/2023-07:25:57] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0232196 [07/20/2023-07:25:57] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 8.79368 seconds. Fastest Tactic: 0x000000000000001c Time: 0.0230446 [07/20/2023-07:25:57] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [07/20/2023-07:25:57] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) -> Half((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) where E0=(MUL_ADD 80 T -160) E1=(MUL_ADD 640 T -1280) *************** [07/20/2023-07:25:57] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:25:57] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0107716 [07/20/2023-07:25:57] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00841734 [07/20/2023-07:25:58] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00758376 [07/20/2023-07:25:58] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00722766 [07/20/2023-07:25:58] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00650265 [07/20/2023-07:25:58] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00603219 [07/20/2023-07:25:59] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.0069858 [07/20/2023-07:25:59] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00590574 [07/20/2023-07:25:59] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00558681 [07/20/2023-07:26:00] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00549785 [07/20/2023-07:26:00] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0103445 [07/20/2023-07:26:00] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 3.3553 seconds. Fastest Tactic: 0x0000000000000009 Time: 0.00549785 [07/20/2023-07:26:00] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000009 [07/20/2023-07:26:00] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 320 T -640),1:2,320,4) -> Half((MUL_ADD 320 T -640),1:2,320,4) where E0=(MUL_ADD 320 T -640) *************** [07/20/2023-07:26:00] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:26:00] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00709529 [07/20/2023-07:26:01] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00623185 [07/20/2023-07:26:01] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00583936 [07/20/2023-07:26:01] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00577207 [07/20/2023-07:26:02] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00582199 [07/20/2023-07:26:02] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00525453 [07/20/2023-07:26:02] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00551719 [07/20/2023-07:26:02] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00558629 [07/20/2023-07:26:03] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00541037 [07/20/2023-07:26:03] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.0055796 [07/20/2023-07:26:03] [V] [TRT] Tactic: 0x000000000000000a Time: 0.0114187 [07/20/2023-07:26:04] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00899286 [07/20/2023-07:26:04] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00790641 [07/20/2023-07:26:04] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00744571 [07/20/2023-07:26:05] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00664436 [07/20/2023-07:26:05] [V] [TRT] Tactic: 0x000000000000000f Time: 0.0061659 [07/20/2023-07:26:05] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00707875 [07/20/2023-07:26:06] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00614933 [07/20/2023-07:26:06] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00551297 [07/20/2023-07:26:06] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00560299 [07/20/2023-07:26:06] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00687303 [07/20/2023-07:26:07] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0112865 [07/20/2023-07:26:07] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 6.78245 seconds. Fastest Tactic: 0x0000000000000005 Time: 0.00525453 [07/20/2023-07:26:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000005 [07/20/2023-07:26:07] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 80 T -160),1:8,80,1) -> Half((MUL_ADD 80 T -160),1:8,80,1) where E0=(MUL_ADD 80 T -160) *************** [07/20/2023-07:26:07] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:26:07] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00503031 [07/20/2023-07:26:07] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00490225 [07/20/2023-07:26:08] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.00529304 [07/20/2023-07:26:08] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00556378 [07/20/2023-07:26:08] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00590336 [07/20/2023-07:26:09] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.00619428 [07/20/2023-07:26:09] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.00790352 [07/20/2023-07:26:10] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00763813 [07/20/2023-07:26:10] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00794819 [07/20/2023-07:26:11] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.00809575 [07/20/2023-07:26:11] [V] [TRT] Tactic: 0x000000000000000a Time: 0.00563393 [07/20/2023-07:26:11] [V] [TRT] Tactic: 0x000000000000000b Time: 0.00531234 [07/20/2023-07:26:11] [V] [TRT] Tactic: 0x000000000000000c Time: 0.00523755 [07/20/2023-07:26:12] [V] [TRT] Tactic: 0x000000000000000d Time: 0.00526531 [07/20/2023-07:26:12] [V] [TRT] Tactic: 0x000000000000000e Time: 0.00525812 [07/20/2023-07:26:12] [V] [TRT] Tactic: 0x000000000000000f Time: 0.00526629 [07/20/2023-07:26:13] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.00601181 [07/20/2023-07:26:13] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.00591287 [07/20/2023-07:26:14] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.00583936 [07/20/2023-07:26:14] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.00635389 [07/20/2023-07:26:14] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.00746171 [07/20/2023-07:26:15] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.00652841 [07/20/2023-07:26:15] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.00596038 [07/20/2023-07:26:15] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.00579547 [07/20/2023-07:26:15] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.011431 [07/20/2023-07:26:16] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.00889708 [07/20/2023-07:26:16] [V] [TRT] Tactic: 0x000000000000001a Time: 0.00743954 [07/20/2023-07:26:16] [V] [TRT] Tactic: 0x000000000000001b Time: 0.00709812 [07/20/2023-07:26:17] [V] [TRT] Tactic: 0x000000000000001c Time: 0.00499894 [07/20/2023-07:26:17] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0055564 [07/20/2023-07:26:17] [V] [TRT] Tactic: 0x000000000000001e Time: 0.00733623 [07/20/2023-07:26:18] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0112527 [07/20/2023-07:26:18] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 10.7365 seconds. Fastest Tactic: 0x0000000000000001 Time: 0.00490225 [07/20/2023-07:26:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x0000000000000001 [07/20/2023-07:26:18] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 80 T -160),1:16,80,1) -> Half((MUL_ADD 80 T -160),1:16,80,1) where E0=(MUL_ADD 80 T -160) *************** [07/20/2023-07:26:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:26:18] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0232444 [07/20/2023-07:26:18] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0236983 [07/20/2023-07:26:18] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0234273 [07/20/2023-07:26:18] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 0.928767 seconds. Fastest Tactic: 0x000000000000001d Time: 0.0232444 [07/20/2023-07:26:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001d [07/20/2023-07:26:18] [V] [TRT] *************** Autotuning format combination: Half(1:8,(* (+ T -2) E1),E1,E0) where E0=(CEIL_DIV N 8) E1=(* 80 E0) -> Half(1:8,(* (+ T -2) E1),E1,E0) where E0=(CEIL_DIV N 8) E1=(* 80 E0) where E0=(CEIL_DIV N 8) E1=(* 80 E0) E2=(* (+ T -2) E1) *************** [07/20/2023-07:26:18] [V] [TRT] --------------- Timing Runner: PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) [07/20/2023-07:26:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.177445 [07/20/2023-07:26:19] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.23157 [07/20/2023-07:26:19] [V] [TRT] Tactic: 0x0000000000000002 Time: 0.215918 [07/20/2023-07:26:20] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.279817 [07/20/2023-07:26:20] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.306322 [07/20/2023-07:26:21] [V] [TRT] Tactic: 0x0000000000000005 Time: 0.251904 [07/20/2023-07:26:21] [V] [TRT] Tactic: 0x0000000000000006 Time: 0.443287 [07/20/2023-07:26:21] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.413403 [07/20/2023-07:26:22] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.434761 [07/20/2023-07:26:22] [V] [TRT] Tactic: 0x0000000000000009 Time: 0.431397 [07/20/2023-07:26:23] [V] [TRT] Tactic: 0x000000000000000a Time: 0.150089 [07/20/2023-07:26:23] [V] [TRT] Tactic: 0x000000000000000b Time: 0.179054 [07/20/2023-07:26:23] [V] [TRT] Tactic: 0x000000000000000c Time: 0.157989 [07/20/2023-07:26:24] [V] [TRT] Tactic: 0x000000000000000d Time: 0.222341 [07/20/2023-07:26:24] [V] [TRT] Tactic: 0x000000000000000e Time: 0.206263 [07/20/2023-07:26:24] [V] [TRT] Tactic: 0x000000000000000f Time: 0.171154 [07/20/2023-07:26:25] [V] [TRT] Tactic: 0x0000000000000010 Time: 0.313198 [07/20/2023-07:26:25] [V] [TRT] Tactic: 0x0000000000000011 Time: 0.275749 [07/20/2023-07:26:25] [V] [TRT] Tactic: 0x0000000000000012 Time: 0.249417 [07/20/2023-07:26:26] [V] [TRT] Tactic: 0x0000000000000013 Time: 0.222354 [07/20/2023-07:26:26] [V] [TRT] Tactic: 0x0000000000000014 Time: 0.122745 [07/20/2023-07:26:27] [V] [TRT] Tactic: 0x0000000000000015 Time: 0.144823 [07/20/2023-07:26:27] [V] [TRT] Tactic: 0x0000000000000016 Time: 0.175689 [07/20/2023-07:26:27] [V] [TRT] Tactic: 0x0000000000000017 Time: 0.242542 [07/20/2023-07:26:27] [V] [TRT] Tactic: 0x0000000000000018 Time: 0.104229 [07/20/2023-07:26:28] [V] [TRT] Tactic: 0x0000000000000019 Time: 0.128951 [07/20/2023-07:26:28] [V] [TRT] Tactic: 0x000000000000001a Time: 0.146578 [07/20/2023-07:26:28] [V] [TRT] Tactic: 0x000000000000001b Time: 0.196315 [07/20/2023-07:26:29] [V] [TRT] Tactic: 0x000000000000001c Time: 0.0230713 [07/20/2023-07:26:29] [V] [TRT] Tactic: 0x000000000000001d Time: 0.0237401 [07/20/2023-07:26:29] [V] [TRT] Tactic: 0x000000000000001e Time: 0.0235298 [07/20/2023-07:26:30] [V] [TRT] Tactic: 0x000000000000001f Time: 0.0293449 [07/20/2023-07:26:30] [V] [TRT] PWN(PWN(/encoder_embed/conv/3/Constant_output_0 + (Unnamed Layer* 8) [Shuffle], /encoder_embed/conv/3/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/3/Constant_2_output_0 + (Unnamed Layer* 14) [Shuffle], /encoder_embed/conv/3/Sub_1), PWN(/encoder_embed/conv/3/Abs)), PWN(/encoder_embed/conv/3/Neg)), PWN(/encoder_embed/conv/3/Exp)), /encoder_embed/conv/3/Constant_3_output_0 + (Unnamed Layer* 20) [Shuffle] + /encoder_embed/conv/3/Add), PWN(/encoder_embed/conv/3/Log)), PWN(PWN(/encoder_embed/conv/3/Constant_1_output_0 + (Unnamed Layer* 11) [Shuffle], /encoder_embed/conv/3/Max), /encoder_embed/conv/3/Add_1)), PWN(/encoder_embed/conv/3/Constant_4_output_0 + (Unnamed Layer* 25) [Shuffle] + /encoder_embed/conv/3/Mul, /encoder_embed/conv/3/Sub_2)), PWN(/encoder_embed/conv/3/Constant_5_output_0 + (Unnamed Layer* 29) [Shuffle], /encoder_embed/conv/3/Sub_3))) (PointWiseV2[0x80000028]) profiling completed in 11.1587 seconds. Fastest Tactic: 0x000000000000001c Time: 0.0230713 [07/20/2023-07:26:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0x000000000000001c [07/20/2023-07:26:30] [V] [TRT] =============== Computing costs for /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) [07/20/2023-07:26:30] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) -> Float((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 0.0746789 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 0.0500297 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 0.0478933 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 0.0741669 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 Time: 0.0738743 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0xede36641840ce3d2 Time: 0.059453 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 0.0460069 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x1673e3594ce11cea Time: 0.0555398 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 0.0447634 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 0.0726903 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x7fc93550f5b9c127 Time: 0.0532373 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 0.0575878 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 Time: 0.0726309 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 0.0400823 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 0.0548571 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x31aa67f57c5aea77 Time: 0.0526095 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 0.0448731 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c Time: 0.0842606 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 Time: 0.0483231 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 0.0374194 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 0.0485181 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0xe640ceafd7d34ca9 Time: 0.0478354 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 0.0525531 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x8ad32616b1424be4 Time: 0.0385829 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 Time: 0.0460777 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x3712e3e595645874 Time: 0.0450926 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 0.0488594 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 Time: 0.0350592 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 0.0854309 [07/20/2023-07:26:30] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.424075 seconds. Fastest Tactic: 0x9808072e706def96 Time: 0.0350592 [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:30] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9808072e706def96 [07/20/2023-07:26:30] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 640 T -1280),1,640,8) -> Float((MUL_ADD 1248 (CEIL_DIV (+ T -6) 2) 1248),1,1248,32) *************** [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 Time: 0.129755 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 0.0518827 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 0.0486156 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee Time: 0.0557349 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 0.0452023 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x5953bec563d26434 Time: 0.0410377 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 0.0719726 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 0.0608549 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 0.0465554 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x32059de4888dfdda Time: 0.0423497 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 0.046192 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 0.0422034 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 Time: 0.0831634 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 0.0433806 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 0.0512503 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 0.0418011 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 Time: 0.0502735 [07/20/2023-07:26:30] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.080977 seconds. Fastest Tactic: 0x5953bec563d26434 Time: 0.0410377 [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5953bec563d26434 [07/20/2023-07:26:30] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 160 T -320),1:4,160,2) -> Float((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0xe8f7b6a5bab325f8 Time: 0.0719726 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0x9fd9fe001908ce2e Time: 0.0707596 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3_alignc4 Tactic: 0x1323e48791e2f671 Time: 0.0676693 [07/20/2023-07:26:30] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.0148237 seconds. Fastest Tactic: 0x1323e48791e2f671 Time: 0.0676693 [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:30] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:30] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1323e48791e2f671 [07/20/2023-07:26:30] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 160 T -320),1:4,160,2) -> Float((MUL_ADD 312 (CEIL_DIV (+ T -6) 2) 312),1:4,312,8) *************** [07/20/2023-07:26:30] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d Time: 0.0371589 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 Time: 0.042928 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 Time: 0.0351899 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 Time: 0.041216 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 Time: 0.0371931 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 Time: 0.0412891 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 Time: 0.0445394 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 Time: 0.0419109 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 Time: 0.0409669 [07/20/2023-07:26:30] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba Time: 0.043024 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef Time: 0.0376686 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 Time: 0.0379977 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 Time: 0.048128 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b Time: 0.0514926 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b Time: 0.0634392 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 Time: 0.0374857 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 Time: 0.0400777 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 Time: 0.0362046 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 Time: 0.0397897 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde Time: 0.0359497 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 Time: 0.0413989 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 Time: 0.0356645 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 Time: 0.0397246 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 Time: 0.0412571 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 Time: 0.0632808 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 Time: 0.0654004 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 Time: 0.0469577 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 Time: 0.0424594 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 Time: 0.0407863 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd Time: 0.03752 [07/20/2023-07:26:31] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.41874 seconds. Fastest Tactic: 0x3a8712b17741b582 Time: 0.0351899 [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:31] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3a8712b17741b582 [07/20/2023-07:26:31] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 640 T -1280),(MUL_ADD 80 T -160),80,1) -> Half((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:31] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:31] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 320 T -640),1:2,320,4) -> Half((MUL_ADD 624 (CEIL_DIV (+ T -6) 2) 624),1:2,624,16) *************** [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.027008 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.0200411 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.0286391 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0220264 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.0261608 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.0238743 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0207752 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0194211 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.0210442 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0221727 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.0302811 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0227997 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.0272823 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.0310126 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.0164465 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0195657 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_image_first_layer_f16f16_f32_f16_nhwckrsc_nhwc_hmma_k32c8r3s3_stride2x2_tile16x64x32_tensor1688 Tactic: 0xea84df118eacb1d8 Time: 0.0247299 [07/20/2023-07:26:31] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.368106 seconds. Fastest Tactic: 0x72c5a15b17fc333a Time: 0.0164465 [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:31] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x72c5a15b17fc333a [07/20/2023-07:26:31] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 160 T -320),1:4,160,2) -> Half((MUL_ADD 312 (CEIL_DIV (+ T -6) 2) 312),1:4,312,8) *************** [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:31] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 80 T -160),1:8,80,1) -> Float((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:31] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:31] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:31] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 80 T -160),1:8,80,1) -> Half((MUL_ADD 156 (CEIL_DIV (+ T -6) 2) 156),1:8,156,4) *************** [07/20/2023-07:26:31] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xbbe09945d2c2c518 Time: 0.063488 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x7f544093413d97da Time: 0.0380754 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x92650053128339fe Time: 0.0235729 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x478671be729a42e5 Time: 0.098816 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x10988d21fd0dee65 Time: 0.0923063 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xceace74c60263a32 Time: 0.0934651 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xecff17b04e8a0aaf Time: 0.0224065 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xc1ac7831dbcadcce Time: 0.0525653 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x4db79797bad0af06 Time: 0.0369063 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x4f3d8b11b12caca6 Time: 0.0259368 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x69f0248c464a2b1b Time: 0.0526644 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xcd1874fa76e36ecf Time: 0.0399383 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x1171249e97d91786 Time: 0.0616244 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x49ccdb0be666d52a Time: 0.0252343 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_linkable Tactic: 0x3ad5c48c521207bf Time: 0.09984 [07/20/2023-07:26:31] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x5325990a550c28df Time: 0.0512975 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0xad01c782980ed344 Time: 0.0408217 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_linkable Tactic: 0x5fef6e4365fb2352 Time: 0.0617722 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x7c453970db78afe5 Time: 0.0609432 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x1749bc4a2c713d9c Time: 0.064573 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x566ebbcc3bece0aa Time: 0.0402949 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xa73c8892ac56b543 Time: 0.0633417 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x7addc91c432117b9 Time: 0.0384674 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x624def210fcdfaed Time: 0.0509074 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xdce100b9fe609424 Time: 0.026112 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x9d562342491490bf Time: 0.0170829 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x18d13b6b3c8edcbe Time: 0.0192549 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0xfbf5ea2d8a6293cd Time: 0.0162763 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x280b0ad3c23d8442 Time: 0.0148197 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.0252152 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x1498693488a7556d Time: 0.0200777 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0xf8d05b73dd3c8ff0 Time: 0.0191314 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.0183234 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xdf2bb9dcbfb149ec Time: 0.0288713 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0xfb0beb2dd64ff6e8 Time: 0.0154793 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.0269303 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x2b2ebb8d9563987f Time: 0.019104 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x9785ceb86b4122d6 Time: 0.0151291 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0203337 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.0245029 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.0221048 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0xfeb4e5d6176dd16f Time: 0.0148494 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0191817 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0177707 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0xa47a4e5ec2ac6617 Time: 0.0150217 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x112767cf498572ea Time: 0.0161077 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0xa5a46bfbd719d757 Time: 0.0164317 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.0194011 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x1a092d9c78bdc1b4 Time: 0.0167939 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0205198 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x3507353e207bcdee Time: 0.0190903 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0xb17d53d15dfbfc9e Time: 0.0531505 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x21b295c0c8f6c95a Time: 0.0474251 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xe1ff5ad20f5c6bf6 Time: 0.0472503 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x2af09e2880d6293f Time: 0.0193829 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x1202d6911edb6ed7 Time: 0.019216 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x0866ddee325d07a6 Time: 0.0347282 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa570c55d303796ff Time: 0.0335872 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x4a81ea1e51436a30 Time: 0.054816 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x0e07ff4f4f7c1ac9 Time: 0.0518827 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0xf82e5a738111ead5 Time: 0.0224653 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xc9d24bd069159fa8 Time: 0.0370137 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x1bf48a356bd0c083 Time: 0.014891 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xe607d4c03409bf44 Time: 0.0238484 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x263a38afd75e3a43 Time: 0.053248 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.028672 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0210233 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x29d52f76d7883502 Time: 0.0161453 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xf79479a62ea9f901 Time: 0.0264533 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x7784aea08af37198 Time: 0.0164272 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x93c767eab90e0466 Time: 0.0180846 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x5874b7028e1818e7 Time: 0.0244053 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x96786911782c23e1 Time: 0.0169265 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0x7005d10718f6c22d Time: 0.0826514 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x245530c34bd6090f Time: 0.0495421 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.0256488 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.0294107 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16_aACCESS Tactic: 0x841c601dec2a75bc Time: 0.0538301 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x30e8a8d7a953e5e9 Time: 0.0591969 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x777aafa0d6de14bd Time: 0.0155662 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.0148187 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xafd1e8bf6bd3d638 Time: 0.052224 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0179063 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x955dd84f2f723fdc Time: 0.0196011 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16 Tactic: 0x7273dde1d0cd3bd5 Time: 0.0495421 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x2db40428031fa3c5 Time: 0.0175868 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_image_first_layer_f16f16_f32_f16_nhwckrsc_nhwc_hmma_k32c8r3s3_stride2x2_tile16x64x32_tensor1688 Tactic: 0xea84df118eacb1d8 Time: 0.0231713 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x866e7a5f6401b67f Time: 0.0789943 [07/20/2023-07:26:32] [V] [TRT] /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.828998 seconds. Fastest Tactic: 0x72c5a15b17fc333a Time: 0.0148187 [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/4/Conv + PWN(PWN(/encoder_embed/conv/6/Constant_output_0 + (Unnamed Layer* 33) [Shuffle], /encoder_embed/conv/6/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/6/Constant_2_output_0 + (Unnamed Layer* 39) [Shuffle], /encoder_embed/conv/6/Sub_1), PWN(/encoder_embed/conv/6/Abs)), PWN(/encoder_embed/conv/6/Neg)), PWN(/encoder_embed/conv/6/Exp)), /encoder_embed/conv/6/Constant_3_output_0 + (Unnamed Layer* 45) [Shuffle] + /encoder_embed/conv/6/Add), PWN(/encoder_embed/conv/6/Log)), PWN(PWN(/encoder_embed/conv/6/Constant_1_output_0 + (Unnamed Layer* 36) [Shuffle], /encoder_embed/conv/6/Max), /encoder_embed/conv/6/Add_1)), PWN(/encoder_embed/conv/6/Constant_4_output_0 + (Unnamed Layer* 50) [Shuffle] + /encoder_embed/conv/6/Mul, /encoder_embed/conv/6/Sub_2)), PWN(/encoder_embed/conv/6/Constant_5_output_0 + (Unnamed Layer* 54) [Shuffle], /encoder_embed/conv/6/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:32] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x72c5a15b17fc333a [07/20/2023-07:26:32] [V] [TRT] =============== Computing costs for /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) [07/20/2023-07:26:32] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 0.168082 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 0.157134 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 0.159598 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 0.16779 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 Time: 0.166327 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0xede36641840ce3d2 Time: 0.193513 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 0.226158 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x1673e3594ce11cea Time: 0.17803 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 0.231739 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 0.163694 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x7fc93550f5b9c127 Time: 0.169399 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 0.299154 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x01cf8ce2da913006 Time: 0.160475 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 0.192951 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 0.174958 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x31aa67f57c5aea77 Time: 0.168521 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 0.219154 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4efce38acc876f5c Time: 0.193243 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x4727434768e46395 Time: 0.153161 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 0.180517 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 0.161938 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0xe640ceafd7d34ca9 Time: 0.153454 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 0.172763 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x8ad32616b1424be4 Time: 0.192658 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 Time: 0.150967 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4_beta0_packed_stride Tactic: 0x3712e3e595645874 Time: 0.146725 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 0.1536 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 Time: 0.175543 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 0.19339 [07/20/2023-07:26:32] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.166611 seconds. Fastest Tactic: 0x3712e3e595645874 Time: 0.146725 [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:32] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:32] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3712e3e595645874 [07/20/2023-07:26:32] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 1248 (CEIL_DIV (+ T -6) 2) 1248),1,1248,32) -> Float((MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432),1,2432,128) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3f0c846d6379bc98 Time: 0.268142 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 0.162816 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 0.238592 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xf48db81f02eca9ee Time: 0.182565 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 0.202021 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x5953bec563d26434 Time: 0.197047 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 0.186373 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 0.182565 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 0.237568 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x32059de4888dfdda Time: 0.206555 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 0.196169 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 0.198949 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xd15dd11d64344e83 Time: 0.178322 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 0.214601 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 0.153015 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 0.178761 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x94a7db94ba744c45 Time: 0.150967 [07/20/2023-07:26:32] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.09512 seconds. Fastest Tactic: 0x94a7db94ba744c45 Time: 0.150967 [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:32] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x94a7db94ba744c45 [07/20/2023-07:26:32] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 312 (CEIL_DIV (+ T -6) 2) 312),1:4,312,8) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0xe8f7b6a5bab325f8 Time: 0.122718 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0x9fd9fe001908ce2e Time: 0.119072 [07/20/2023-07:26:32] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3_alignc4 Tactic: 0x1323e48791e2f671 Time: 0.118053 [07/20/2023-07:26:32] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.0165142 seconds. Fastest Tactic: 0x1323e48791e2f671 Time: 0.118053 [07/20/2023-07:26:32] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:32] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1323e48791e2f671 [07/20/2023-07:26:32] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 312 (CEIL_DIV (+ T -6) 2) 312),1:4,312,8) -> Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x96467934a22da27d Time: 0.161646 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x9355e195cee05798 Time: 0.1424 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x3a8712b17741b582 Time: 0.114103 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0xb3e5ce9d1b1da232 Time: 0.216795 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xb6f6563c77d057d7 Time: 0.115346 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xe9e5475c77d60638 Time: 0.161499 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x43ffe5cf09cee087 Time: 0.236544 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x4640eb34c8ecc700 Time: 0.177006 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0x3f948a101b8c4067 Time: 0.174226 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xfed494d61b2087ba Time: 0.125513 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x72a5d05b1bb165ef Time: 0.122368 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x9cb304e2edbc1221 Time: 0.123319 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xf78ec258f27b3e23 Time: 0.186514 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x1acd4f006848c62b Time: 0.192805 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b Time: 0.117175 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0xcc46f0f5cee60677 Time: 0.132096 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x7e40882e33c8fbf1 Time: 0.195145 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc8 Tactic: 0x4037b478ce77e422 Time: 0.150661 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_alignc4 Tactic: 0x1a373db9a2bc4028 Time: 0.16267 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x10383a0781d24dde Time: 0.130359 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc8 Tactic: 0x7bff86d5f2eadc76 Time: 0.179346 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb33296dda7141c64 Time: 0.115712 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4 Tactic: 0x570667f2a28165a0 Time: 0.188123 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0x93030576a9fb03f9 Time: 0.128805 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x999e005e3b016ea6 Time: 0.116078 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 Time: 0.120101 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc8 Tactic: 0x22cadc265a3b2e32 Time: 0.225303 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8_alignc4 Tactic: 0xab0496509b88ebe0 Time: 0.159598 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna8 Tactic: 0xdb77237fa21087f5 Time: 0.177445 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xae48d3ccfe1edfcd Time: 0.147163 [07/20/2023-07:26:33] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.158914 seconds. Fastest Tactic: 0x3a8712b17741b582 Time: 0.114103 [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x3a8712b17741b582 [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 1248 E0 1248),(MUL_ADD 39 E0 39),39,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:33] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 624 (CEIL_DIV (+ T -6) 2) 624),1:2,624,16) -> Half((MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216),1:2,1216,64) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.110885 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.111177 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.121344 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.10101 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.162231 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.123831 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0852114 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0713493 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.1024 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0934034 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.15872 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0792137 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.16896 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.166766 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.073216 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0944274 [07/20/2023-07:26:33] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.0772709 seconds. Fastest Tactic: 0xa1c540a5038e4190 Time: 0.0713493 [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa1c540a5038e4190 [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 312 (CEIL_DIV (+ T -6) 2) 312),1:4,312,8) -> Half((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 156 (CEIL_DIV (+ T -6) 2) 156),1:8,156,4) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 156 (CEIL_DIV (+ T -6) 2) 156),1:8,156,4) -> Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xbbe09945d2c2c518 Time: 0.0456411 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x7f544093413d97da Time: 0.0753189 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x92650053128339fe Time: 0.04608 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x478671be729a42e5 Time: 0.0659749 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x10988d21fd0dee65 Time: 0.0616351 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xceace74c60263a32 Time: 0.0623177 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xecff17b04e8a0aaf Time: 0.0452389 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xc1ac7831dbcadcce Time: 0.0579291 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x4db79797bad0af06 Time: 0.0440057 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x4f3d8b11b12caca6 Time: 0.0533455 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x69f0248c464a2b1b Time: 0.058173 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0xcd1874fa76e36ecf Time: 0.0469554 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x1171249e97d91786 Time: 0.0429714 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x49ccdb0be666d52a Time: 0.0520777 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_linkable Tactic: 0x3ad5c48c521207bf Time: 0.0661211 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x5325990a550c28df Time: 0.0566613 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0xad01c782980ed344 Time: 0.047104 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_linkable Tactic: 0x5fef6e4365fb2352 Time: 0.0495863 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x7c453970db78afe5 Time: 0.0494446 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x1749bc4a2c713d9c Time: 0.0457109 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x566ebbcc3bece0aa Time: 0.0787749 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xa73c8892ac56b543 Time: 0.0439223 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x7addc91c432117b9 Time: 0.0453531 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_linkable Tactic: 0x624def210fcdfaed Time: 0.0564617 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xdce100b9fe609424 Time: 0.0526141 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x9d562342491490bf Time: 0.0668907 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x18d13b6b3c8edcbe Time: 0.0563688 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0xfbf5ea2d8a6293cd Time: 0.0589531 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x280b0ad3c23d8442 Time: 0.0489173 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x6a76904d34985d11 Time: 0.107447 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x1498693488a7556d Time: 0.0871131 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0xf8d05b73dd3c8ff0 Time: 0.0699733 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xb97671b320ea2fbb Time: 0.10752 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xdf2bb9dcbfb149ec Time: 0.153307 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0xfb0beb2dd64ff6e8 Time: 0.0918491 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xe522659e6357a379 Time: 0.118638 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x2b2ebb8d9563987f Time: 0.062659 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x9785ceb86b4122d6 Time: 0.045824 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x17bdd86adff94950 Time: 0.0972069 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0xd405f38f8e89fab2 Time: 0.15872 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x362284607725d1d3 Time: 0.121051 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0xfeb4e5d6176dd16f Time: 0.0734446 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0xfd9154884033cd52 Time: 0.0827977 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0xa1c540a5038e4190 Time: 0.0675352 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0xa47a4e5ec2ac6617 Time: 0.0520777 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x112767cf498572ea Time: 0.0646095 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0xa5a46bfbd719d757 Time: 0.0574903 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x90e2d6b4ee50185b Time: 0.097792 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x1a092d9c78bdc1b4 Time: 0.0704579 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x98e92db98836b738 Time: 0.0890149 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x3507353e207bcdee Time: 0.107081 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0xb17d53d15dfbfc9e Time: 0.0481768 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x21b295c0c8f6c95a Time: 0.0568152 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xe1ff5ad20f5c6bf6 Time: 0.0887954 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc2 Tactic: 0x2af09e2880d6293f Time: 0.07104 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x1202d6911edb6ed7 Time: 0.0753371 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x0866ddee325d07a6 Time: 0.04608 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa570c55d303796ff Time: 0.0458263 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x4a81ea1e51436a30 Time: 0.0615375 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x0e07ff4f4f7c1ac9 Time: 0.0460069 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0xf82e5a738111ead5 Time: 0.0960366 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xc9d24bd069159fa8 Time: 0.0452446 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x1bf48a356bd0c083 Time: 0.0449097 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0xe607d4c03409bf44 Time: 0.104375 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x263a38afd75e3a43 Time: 0.0568518 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc4 Tactic: 0x535afd51bf20abb9 Time: 0.155927 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc2 Tactic: 0x2e91b5765441bff8 Time: 0.0762011 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc8 Tactic: 0x29d52f76d7883502 Time: 0.0568213 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xf79479a62ea9f901 Time: 0.0500297 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_alignc4 Tactic: 0x7784aea08af37198 Time: 0.0601234 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x93c767eab90e0466 Time: 0.0882103 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc8 Tactic: 0x5874b7028e1818e7 Time: 0.147017 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc8 Tactic: 0x96786911782c23e1 Time: 0.0700221 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0x7005d10718f6c22d Time: 0.062464 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x245530c34bd6090f Time: 0.0431154 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0x5b51065cd94604da Time: 0.166432 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna2_alignc2 Tactic: 0xdc0e0882e8ef55d1 Time: 0.163109 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16_aACCESS Tactic: 0x841c601dec2a75bc Time: 0.0585554 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r3s3_aACCESS Tactic: 0x30e8a8d7a953e5e9 Time: 0.0618941 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc4 Tactic: 0x777aafa0d6de14bd Time: 0.0901852 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x72c5a15b17fc333a Time: 0.0700709 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xafd1e8bf6bd3d638 Time: 0.042064 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc4 Tactic: 0x1fb62367b99fe633 Time: 0.0898172 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna8_alignc2 Tactic: 0x955dd84f2f723fdc Time: 0.0792869 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16 Tactic: 0x7273dde1d0cd3bd5 Time: 0.0575771 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x64_stage1_warpsize4x1x1_g1_tensor16x8x16_aligna4_alignc8 Tactic: 0x2db40428031fa3c5 Time: 0.0669943 [07/20/2023-07:26:33] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x866e7a5f6401b67f Time: 0.0609524 [07/20/2023-07:26:33] [V] [TRT] /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.567153 seconds. Fastest Tactic: 0xafd1e8bf6bd3d638 Time: 0.042064 [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /encoder_embed/conv/7/Conv + PWN(PWN(/encoder_embed/conv/9/Constant_output_0 + (Unnamed Layer* 58) [Shuffle], /encoder_embed/conv/9/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/conv/9/Constant_2_output_0 + (Unnamed Layer* 64) [Shuffle], /encoder_embed/conv/9/Sub_1), PWN(/encoder_embed/conv/9/Abs)), PWN(/encoder_embed/conv/9/Neg)), PWN(/encoder_embed/conv/9/Exp)), /encoder_embed/conv/9/Constant_3_output_0 + (Unnamed Layer* 70) [Shuffle] + /encoder_embed/conv/9/Add), PWN(/encoder_embed/conv/9/Log)), PWN(PWN(/encoder_embed/conv/9/Constant_1_output_0 + (Unnamed Layer* 61) [Shuffle], /encoder_embed/conv/9/Max), /encoder_embed/conv/9/Add_1)), PWN(/encoder_embed/conv/9/Constant_4_output_0 + (Unnamed Layer* 75) [Shuffle] + /encoder_embed/conv/9/Mul, /encoder_embed/conv/9/Sub_2)), PWN(/encoder_embed/conv/9/Constant_5_output_0 + (Unnamed Layer* 79) [Shuffle], /encoder_embed/conv/9/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:33] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xafd1e8bf6bd3d638 [07/20/2023-07:26:33] [V] [TRT] =============== Computing costs for /ReduceMax [07/20/2023-07:26:33] [V] [TRT] *************** Autotuning format combination: Int32(1) -> Int32() *************** [07/20/2023-07:26:33] [V] [TRT] --------------- Timing Runner: /ReduceMax (Reduce[0x8000000e]) [07/20/2023-07:26:34] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.00370415 [07/20/2023-07:26:34] [V] [TRT] Tactic: 0x0000000000000003 Time: 0.00369876 [07/20/2023-07:26:34] [V] [TRT] Tactic: 0x0000000000000004 Time: 0.00404203 [07/20/2023-07:26:34] [V] [TRT] Tactic: 0x0000000000000007 Time: 0.00406514 [07/20/2023-07:26:34] [V] [TRT] Tactic: 0x0000000000000008 Time: 0.00408749 [07/20/2023-07:26:34] [V] [TRT] /ReduceMax (Reduce[0x8000000e]) profiling completed in 0.311161 seconds. Fastest Tactic: 0x0000000000000003 Time: 0.00369876 [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /ReduceMax (MyelinReduce[0x8000003e]) [07/20/2023-07:26:34] [V] [TRT] MyelinReduce has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000003 [07/20/2023-07:26:34] [V] [TRT] =============== Computing costs for /encoder_embed/convnext/depthwise_conv/Conv [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) E2=(MUL_ADD 2432 E0 -2432) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 4.7168 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 2.76217 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize128x32_threadsize64x4_general Tactic: 0x02aff33b8cd106c8 Time: 0.224695 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0xa9366041633a5135 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 2.35827 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0xcb8a43f748d8a338 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 2.13504 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x8_threadsize32x4 Tactic: 0xd1a22ad13e727070 Time: 0.192809 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0x40a12e3938221818 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 1.9712 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0xd828f024626fa982 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 2.7648 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize32x8_threadsize32x4_general Tactic: 0x93ba18009b18a330 Time: 0.198363 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0xf64396b97c889179 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 2.93069 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x16_threadsize64x2 Tactic: 0x36688904578c3005 Time: 0.304421 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_generic Tactic: 0xc9d0e04a5184cb3e Time: 0.286427 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm70_xmma_convolution_depthwiseConv_fp32fp32_trt_kernel_fp32_TR_TS Tactic: 0x9934205e4f120728 Time: 0.167058 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize128x8_threadsize128x1 Tactic: 0x966f5e7809fca289 Time: 0.301056 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize64x8_threadsize64x2_general Tactic: 0x00753944b0df80b7 Time: 0.194245 [07/20/2023-07:26:34] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.177336 seconds. Fastest Tactic: 0x9934205e4f120728 Time: 0.167058 [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9934205e4f120728 [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432),1,2432,128) -> Float((MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432),1,2432,128) where E0=(MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 12.3532 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 1.52532 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0x4fd3c46622e98342 which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 6.6519 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 1.48641 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0x0a143be7a52f301a which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 8.23398 [07/20/2023-07:26:34] [V] [TRT] Fast skip Tactic:0xa6448a1e79f1ca6f which exceed time limit during pre-run [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 7.88173 [07/20/2023-07:26:34] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.224578 seconds. Fastest Tactic: 0xf231cca3335919a4 Time: 1.48641 [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf231cca3335919a4 [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize64x8_threadsize64x2_general_alignC4 Tactic: 0xf7bc7502ac7dff9b Time: 0.275456 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize128x32_threadsize64x4_general_alignC4 Tactic: 0x5d176f6a3900f1fd Time: 0.305152 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_convolution_trt_depthwiseFP32NHWC4_fp32nhwcx4_fp32nhwcx4_fp32kcrs Tactic: 0x2cac8ad6921b6398 Time: 0.0903314 [07/20/2023-07:26:34] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0112445 seconds. Fastest Tactic: 0x2cac8ad6921b6398 Time: 0.0903314 [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2cac8ad6921b6398 [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) E2=(MUL_ADD 2432 E0 -2432) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:34] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216),1:2,1216,64) -> Half((MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216),1:2,1216,64) where E0=(MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Half((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) -> Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) where E0=(MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f16f16_f16_f16_ndhwcktrsc_ndhwc_tilesize64x16_threadsize64x2_general_alignC8 Tactic: 0x004bc40835df5b89 Time: 0.14613 [07/20/2023-07:26:34] [V] [TRT] Tactic Name: sm50_xmma_convolution_depthwiseHMMA_FP16NHWCx8_TR_TS_STRIDEH_STRIDEW Tactic: 0x64275a11c9ed1722 Time: 0.15243 [07/20/2023-07:26:34] [V] [TRT] /encoder_embed/convnext/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00420249 seconds. Fastest Tactic: 0x004bc40835df5b89 Time: 0.14613 [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:34] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x004bc40835df5b89 [07/20/2023-07:26:34] [V] [TRT] =============== Computing costs for /ReduceMax_output_0[DevicetoShapeHostCopy] [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Int32() -> *************** [07/20/2023-07:26:34] [V] [TRT] =============== Computing costs for /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) [07/20/2023-07:26:34] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:34] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 0.292425 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 0.271799 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 0.292133 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 Time: 0.29067 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0xede36641840ce3d2 Time: 0.33909 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 0.395995 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x1673e3594ce11cea Time: 0.312759 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 Time: 0.333509 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 0.390597 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 0.305152 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd Time: 0.301495 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 0.487278 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 Time: 0.305006 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 0.338944 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 0.311735 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x31aa67f57c5aea77 Time: 0.315538 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 Time: 0.305591 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x828d0ea88c66fce7 Time: 0.314807 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a Time: 0.295351 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e Time: 0.305298 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 Time: 0.30325 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b Time: 0.24693 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 0.376681 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x16_stage2_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xe52b0ddb126aa135 Time: 0.258633 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 Time: 0.327355 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 Time: 0.248978 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd Time: 0.310857 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 0.306578 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90f8f2915f87ed77 Time: 0.336603 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 0.274432 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x32x16_stage2_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xb2c8ebee321e63d6 Time: 0.28043 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 0.307346 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 Time: 0.269166 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 0.287598 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 Time: 0.307346 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 0.305883 [07/20/2023-07:26:35] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.557108 seconds. Fastest Tactic: 0xa419b3b68f2da07b Time: 0.24693 [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:35] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:35] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [07/20/2023-07:26:35] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432),1,2432,128) -> Float((MUL_ADD 7296 (CEIL_DIV (+ T -6) 2) -7296),1,7296,384) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 0.284087 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 0.351378 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 Time: 0.302226 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 Time: 0.268142 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 Time: 0.302811 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 Time: 0.300471 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 0.307205 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb Time: 0.303543 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 0.30208 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 0.399945 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 Time: 0.306176 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd9eb6ca56ddc3a22 Time: 0.281015 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fb90698107bb33a Time: 0.335872 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 0.340699 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d Time: 0.267557 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 0.364983 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 0.27136 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 0.310126 [07/20/2023-07:26:35] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.138352 seconds. Fastest Tactic: 0x55d80c17b1cd982d Time: 0.267557 [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:35] [V] [TRT] CaskGemmConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:35] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x55d80c17b1cd982d [07/20/2023-07:26:35] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Float((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0xe8f7b6a5bab325f8 Time: 0.241079 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_alignc4 Tactic: 0x440241d9c93d605d Time: 0.236398 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_alignc4 Tactic: 0xc8ad2c0ce0af5623 Time: 0.237568 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0x9fd9fe001908ce2e Time: 0.239762 [07/20/2023-07:26:35] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.025348 seconds. Fastest Tactic: 0x440241d9c93d605d Time: 0.236398 [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:35] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x440241d9c93d605d [07/20/2023-07:26:35] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Float((MUL_ADD 1824 (CEIL_DIV (+ T -6) 2) -1824),1:4,1824,96) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b Time: 0.239035 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 Time: 0.237861 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b Time: 0.239323 [07/20/2023-07:26:35] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 Time: 0.239323 [07/20/2023-07:26:35] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.300296 seconds. Fastest Tactic: 0x9dece0dc37e90462 Time: 0.237861 [07/20/2023-07:26:35] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))): 32 available tactics, 0 unparsable, 16 pruned, 16 remaining after tactic pruning. [07/20/2023-07:26:35] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205b1 Time: 0.222793 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a6 Time: 0.223086 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020553 Time: 0.22133 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020398 Time: 0.222034 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020265 Time: 0.235959 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002027a Time: 0.231424 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f9 Time: 0.229961 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020535 Time: 0.229083 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a8 Time: 0.223525 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a3 Time: 0.222062 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202cf Time: 0.229376 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000204a8 Time: 0.218697 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002043b Time: 0.217088 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202f7 Time: 0.227474 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020854 Time: 0.256 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020384 Time: 0.244736 [07/20/2023-07:26:36] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskGemmConvolution[0x8000002e]) profiling completed in 0.405652 seconds. Fastest Tactic: 0x000000000002043b Time: 0.217088 [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:36] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskGemmConvolution Tactic: 0x000000000002043b [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:36] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CudnnConvolution[0x80000000]) [07/20/2023-07:26:36] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 1216 E0 -1216),(MUL_ADD 19 E0 -19):2,19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 3648 E0 -3648),(MUL_ADD 19 E0 -19):2,19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216),1:2,1216,64) -> Half((MUL_ADD 3648 (CEIL_DIV (+ T -6) 2) -3648),1:2,3648,192) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:36] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) -> Half((MUL_ADD 1824 (CEIL_DIV (+ T -6) 2) -1824),1:4,1824,96) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:36] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) -> Float((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:36] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:36] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:36] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) -> Half((MUL_ADD 912 (CEIL_DIV (+ T -6) 2) -912),1:8,912,48) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:36] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x922672fed8fc9bc9 Time: 0.135808 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x7f0d5746ec359c20 Time: 0.0961097 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0xffd8ae320f4b54b1 Time: 0.0830903 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x92650053128339fe Time: 0.072704 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x5692ab284b03c90b Time: 0.0758491 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xa4bee9667fa7d939 Time: 0.0935497 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x83140fbc4d25e909 Time: 0.0694857 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xfc0316f30e181b95 Time: 0.0820754 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x206a4697ef2262dc Time: 0.0790674 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x5c50cbb261fc5db4 Time: 0.0825051 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xceace74c60263a32 Time: 0.0781166 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xc1ac7831dbcadcce Time: 0.0866743 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0x4f3d8b11b12caca6 Time: 0.0938423 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x5484e10a83bbe5e7 Time: 0.126391 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xfdeabf4c64cce276 Time: 0.077312 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x69f0248c464a2b1b Time: 0.0975726 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x018d25ddd74b06bc Time: 0.072176 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x8f3fdd4c960cf6fe Time: 0.0976457 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0xae9b0ac640f8c135 Time: 0.0702171 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xbe57ab67cccd24cc Time: 0.0857234 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x6211ff9dc30d5ff9 Time: 0.0779063 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xaaf443d3eb5b4ef6 Time: 0.0782629 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_linkable Tactic: 0x3ad5c48c521207bf Time: 0.0780434 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0xa0c5a5fa2311a315 Time: 0.083456 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x6f8f9dd62101f82d Time: 0.0759223 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0xd43ca33182b72c24 Time: 0.0909166 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_linkable Tactic: 0xad01c782980ed344 Time: 0.0794491 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_linkable Tactic: 0x5fef6e4365fb2352 Time: 0.0709455 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1_linkable Tactic: 0x91370b1d42b9a3f6 Time: 0.0705097 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0xf302b613c8da7848 Time: 0.0809006 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x1749bc4a2c713d9c Time: 0.0760686 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0xb9a9987efec1a89b Time: 0.0754651 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x566ebbcc3bece0aa Time: 0.138085 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1_linkable Tactic: 0x5088faa5e5049ecc Time: 0.0781897 [07/20/2023-07:26:36] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0xa73c8892ac56b543 Time: 0.0825783 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_linkable Tactic: 0x7addc91c432117b9 Time: 0.0841874 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xdce100b9fe609424 Time: 0.133559 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0xb17d53d15dfbfc9e Time: 0.129961 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x21b295c0c8f6c95a Time: 0.128087 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xe1ff5ad20f5c6bf6 Time: 0.179493 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa570c55d303796ff Time: 0.123602 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x4a81ea1e51436a30 Time: 0.143945 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x0e07ff4f4f7c1ac9 Time: 0.115655 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xc9d24bd069159fa8 Time: 0.129602 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xf79479a62ea9f901 Time: 0.124123 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0x7005d10718f6c22d Time: 0.12939 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16_aACCESS Tactic: 0x841c601dec2a75bc Time: 0.144091 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xafd1e8bf6bd3d638 Time: 0.122167 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16 Tactic: 0x7273dde1d0cd3bd5 Time: 0.131589 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x866e7a5f6401b67f Time: 0.116663 [07/20/2023-07:26:37] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskConvolution[0x80000009]) profiling completed in 0.724397 seconds. Fastest Tactic: 0x83140fbc4d25e909 Time: 0.0694857 [07/20/2023-07:26:37] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))): 88 available tactics, 0 unparsable, 44 pruned, 44 remaining after tactic pruning. [07/20/2023-07:26:37] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020039 Time: 0.139776 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205c4 Time: 0.137801 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002045d Time: 0.141678 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020848 Time: 0.139264 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020873 Time: 0.142034 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207bf Time: 0.139264 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207e4 Time: 0.13941 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002034a Time: 0.140727 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020991 Time: 0.141751 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206ab Time: 0.140731 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002049d Time: 0.13877 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207ff Time: 0.13824 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002097d Time: 0.148773 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002051a Time: 0.144677 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020074 Time: 0.145993 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203da Time: 0.147895 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020359 Time: 0.134576 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206e7 Time: 0.13312 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209a5 Time: 0.138958 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207d7 Time: 0.132023 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002010c Time: 0.135241 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208bc Time: 0.138825 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020170 Time: 0.149065 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206fe Time: 0.138971 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209ac Time: 0.149797 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020570 Time: 0.1536 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208bd Time: 0.154478 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206ea Time: 0.138971 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020896 Time: 0.143653 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002060d Time: 0.138313 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020679 Time: 0.148183 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002033f Time: 0.138549 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020404 Time: 0.148187 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202af Time: 0.14336 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f6 Time: 0.146286 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206e2 Time: 0.146725 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020095 Time: 0.14731 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f5 Time: 0.146432 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002009e Time: 0.132112 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002055e Time: 0.132315 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020882 Time: 0.150235 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000201bd Time: 0.150674 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020773 Time: 0.155063 [07/20/2023-07:26:37] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020740 Time: 0.155502 [07/20/2023-07:26:37] [V] [TRT] /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskGemmConvolution[0x8000002e]) profiling completed in 0.554534 seconds. Fastest Tactic: 0x00000000000207d7 Time: 0.132023 [07/20/2023-07:26:37] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:37] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:37] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x83140fbc4d25e909 [07/20/2023-07:26:37] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 152 (CEIL_DIV (+ T -6) 2) -152),1:16,152,8) -> Half((MUL_ADD 456 (CEIL_DIV (+ T -6) 2) -456),1:16,456,24) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv1/Conv + PWN(PWN(/encoder_embed/convnext/activation/Constant_output_0 + (Unnamed Layer* 84) [Shuffle], /encoder_embed/convnext/activation/Sub), PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(PWN(/encoder_embed/convnext/activation/Constant_2_output_0 + (Unnamed Layer* 90) [Shuffle], /encoder_embed/convnext/activation/Sub_1), PWN(/encoder_embed/convnext/activation/Abs)), PWN(/encoder_embed/convnext/activation/Neg)), PWN(/encoder_embed/convnext/activation/Exp)), /encoder_embed/convnext/activation/Constant_3_output_0 + (Unnamed Layer* 96) [Shuffle] + /encoder_embed/convnext/activation/Add), PWN(/encoder_embed/convnext/activation/Log)), PWN(PWN(/encoder_embed/convnext/activation/Constant_1_output_0 + (Unnamed Layer* 87) [Shuffle], /encoder_embed/convnext/activation/Max), /encoder_embed/convnext/activation/Add_1)), PWN(/encoder_embed/convnext/activation/Constant_4_output_0 + (Unnamed Layer* 101) [Shuffle] + /encoder_embed/convnext/activation/Mul, /encoder_embed/convnext/activation/Sub_2)), PWN(/encoder_embed/convnext/activation/Constant_5_output_0 + (Unnamed Layer* 105) [Shuffle], /encoder_embed/convnext/activation/Sub_3))) (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] =============== Computing costs for /encoder_embed/convnext/pointwise_conv2/Conv [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 0.166473 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 0.1536 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 0.166181 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_interior_nn_v1 Tactic: 0xa8ef60e712f8ad24 Time: 0.164571 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize1x4x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0xede36641840ce3d2 Time: 0.205824 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 0.234057 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize4x1x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x1673e3594ce11cea Time: 0.18037 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x2ee10e11d6651675 Time: 0.238885 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 0.250907 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 0.140434 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x865894c4635db7fd Time: 0.143529 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 0.339529 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfff46c7893896eb1 Time: 0.196462 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 0.20085 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 0.173349 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage2_warpsize2x2x1_g1_ffma_aligna4_alignc4_beta0_packed_stride Tactic: 0x31aa67f57c5aea77 Time: 0.168229 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9cd5cdc35441c505 Time: 0.144238 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x828d0ea88c66fce7 Time: 0.165449 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fc87d7eb370bb7a Time: 0.144238 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xc0b05b61d128e46e Time: 0.141605 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xe5603263b7f00303 Time: 0.166473 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa419b3b68f2da07b Time: 0.116517 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 0.234935 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x64x16_stage2_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xe52b0ddb126aa135 Time: 0.117614 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x256x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x9de226a0c44627c4 Time: 0.236398 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_aligna4_alignc4 Tactic: 0x7f0145cb49517338 Time: 0.117394 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x8e3884f0eaec3ecd Time: 0.165742 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 0.197193 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90f8f2915f87ed77 Time: 0.199534 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 0.157403 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nchwkrsc_nchw_tilesize128x32x16_stage2_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_aligna4_alignc4 Tactic: 0xb2c8ebee321e63d6 Time: 0.118638 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 0.159598 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_interior_nn_v1 Tactic: 0xc3cf6e1d1c6aff27 Time: 0.143945 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 0.145262 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x9808072e706def96 Time: 0.189257 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 0.197339 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) profiling completed in 0.154414 seconds. Fastest Tactic: 0xa419b3b68f2da07b Time: 0.116517 [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:38] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xa419b3b68f2da07b [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 7296 (CEIL_DIV (+ T -6) 2) -7296),1,7296,384) -> Float((MUL_ADD 2432 (CEIL_DIV (+ T -6) 2) -2432),1,2432,128) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 0.155502 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 0.217088 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x35f26f9c09557d86 Time: 0.159598 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x90898977fc8ce537 Time: 0.142702 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xc7b3afceb5fb03c0 Time: 0.144238 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd55ee6fd0b56f808 Time: 0.150235 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 0.189879 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x1022069e6f8d9aeb Time: 0.158135 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 0.160622 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 0.26507 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xbc0bba0ff1a92939 Time: 0.202021 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xd9eb6ca56ddc3a22 Time: 0.164864 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x1fb90698107bb33a Time: 0.212553 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 0.214894 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x55d80c17b1cd982d Time: 0.142907 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 0.232741 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 0.145554 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 0.181687 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0723405 seconds. Fastest Tactic: 0x90898977fc8ce537 Time: 0.142702 [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:38] [V] [TRT] CaskGemmConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x90898977fc8ce537 [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 1824 (CEIL_DIV (+ T -6) 2) -1824),1:4,1824,96) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0xe8f7b6a5bab325f8 Time: 0.114834 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1_alignc4 Tactic: 0x440241d9c93d605d Time: 0.112128 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1_alignc4 Tactic: 0xc8ad2c0ce0af5623 Time: 0.113006 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nchw_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_alignc4 Tactic: 0x9fd9fe001908ce2e Time: 0.11381 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0206444 seconds. Fastest Tactic: 0x440241d9c93d605d Time: 0.112128 [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x440241d9c93d605d [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 1824 (CEIL_DIV (+ T -6) 2) -1824),1:4,1824,96) -> Float((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x130df49cb195156b Time: 0.108251 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x9dece0dc37e90462 Time: 0.107886 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb443c221fcb1565b Time: 0.108329 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x128x16_stage4_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x65e41d81f093b482 Time: 0.108978 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0155209 seconds. Fastest Tactic: 0x9dece0dc37e90462 Time: 0.107886 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv: 160 available tactics, 0 unparsable, 80 pruned, 80 remaining after tactic pruning. [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205b1 Time: 0.100425 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a6 Time: 0.0988891 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020535 Time: 0.100937 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f9 Time: 0.101669 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020320 Time: 0.0886514 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202b6 Time: 0.0905463 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020553 Time: 0.104151 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020398 Time: 0.104594 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000204a8 Time: 0.0975726 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002043b Time: 0.09728 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202f7 Time: 0.0974263 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202cf Time: 0.0973531 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002037e Time: 0.0974263 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209d4 Time: 0.0973531 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002027a Time: 0.108711 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020265 Time: 0.105838 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a3 Time: 0.10525 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a8 Time: 0.104647 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020854 Time: 0.128293 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020384 Time: 0.116955 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x32x64_stage4_warpsize2x1x2_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002031a Time: 0.131424 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x32x64_stage4_warpsize2x1x2_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202b8 Time: 0.129536 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x32x64_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020368 Time: 0.13195 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x32x64_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002030d Time: 0.129682 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203bc Time: 0.121984 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203a1 Time: 0.122953 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize32x32x64_stage3_warpsize2x1x2_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203be Time: 0.132754 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize32x32x64_stage3_warpsize2x1x2_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202f3 Time: 0.132901 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403a6 Time: 0.19573 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020405b1 Time: 0.193682 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040553 Time: 0.205385 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040398 Time: 0.203191 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize32x32x64_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020378 Time: 0.198802 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize32x32x64_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020436 Time: 0.203483 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040535 Time: 0.194414 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406f9 Time: 0.197047 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040320 Time: 0.141458 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402b6 Time: 0.144677 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204043b Time: 0.133047 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020404a8 Time: 0.133047 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402cf Time: 0.134071 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402f7 Time: 0.133911 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204027a Time: 0.198949 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040265 Time: 0.202459 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x256x32_stage2_warpsize2x4x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202c7 Time: 0.128073 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x256x32_stage2_warpsize2x4x1_tensor16x8x8 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020150 Time: 0.135534 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403a3 Time: 0.138825 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403a8 Time: 0.138459 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040384 Time: 0.143945 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040854 Time: 0.153307 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204037e Time: 0.131584 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020409d4 Time: 0.131365 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040405b1 Time: 0.239909 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040403a6 Time: 0.240503 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403a1 Time: 0.150382 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403bc Time: 0.150382 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040553 Time: 0.244882 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040398 Time: 0.244882 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040535 Time: 0.234935 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x16_stage6_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040406f9 Time: 0.236837 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize32x32x64_stage3_warpsize2x1x2_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403be Time: 0.202459 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize32x32x64_stage3_warpsize2x1x2_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402f3 Time: 0.198217 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040320 Time: 0.173349 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x64x64_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040402b6 Time: 0.173641 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040404a8 Time: 0.178725 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x128x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x000000020404043b Time: 0.179346 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040402cf Time: 0.178176 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x32_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040402f7 Time: 0.178907 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x000000020404027a Time: 0.238738 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x16_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040265 Time: 0.24181 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040403a3 Time: 0.178469 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x128x32_stage3_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040403a8 Time: 0.178761 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x32x64_stage4_warpsize2x1x2_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402b8 Time: 0.231717 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x32x64_stage4_warpsize2x1x2_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204031a Time: 0.238304 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040854 Time: 0.192951 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize256x64x32_stage2_warpsize4x1x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x0000000204040384 Time: 0.185783 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x000000020404037e Time: 0.173787 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize128x64x64_stage2_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 2 numKernels: 2 Tactic: 0x00000002040409d4 Time: 0.174226 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_nn_n_tilesize64x32x64_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040368 Time: 0.240201 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm86_xmma_gemm_f32f32_tf32f32_f32_tn_n_tilesize64x32x64_stage4_warpsize2x2x1_tensor16x8x8 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204030d Time: 0.233765 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskGemmConvolution[0x8000002e]) profiling completed in 0.350516 seconds. Fastest Tactic: 0x0000000000020320 Time: 0.0886514 [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskGemmConvolution Tactic: 0x0000000000020320 [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 7296 E0 -7296),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:38] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 3648 E0 -3648),(MUL_ADD 19 E0 -19):2,19,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 1216 E0 -1216),(MUL_ADD 19 E0 -19):2,19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 3648 (CEIL_DIV (+ T -6) 2) -3648),1:2,3648,192) -> Half((MUL_ADD 1216 (CEIL_DIV (+ T -6) 2) -1216),1:2,1216,64) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 1824 (CEIL_DIV (+ T -6) 2) -1824),1:4,1824,96) -> Half((MUL_ADD 608 (CEIL_DIV (+ T -6) 2) -608),1:4,608,32) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 912 (CEIL_DIV (+ T -6) 2) -912),1:8,912,48) -> Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:38] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:38] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 912 (CEIL_DIV (+ T -6) 2) -912),1:8,912,48) -> Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xdce100b9fe609424 Time: 0.0555886 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 0xb4ed47991b2d81ae Time: 0.0523672 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x3e2d344492eaa731 Time: 0.051395 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0x60da8c7151d91e47 Time: 0.0642194 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x4a33d90483c0ec01 Time: 0.0571977 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x8047bcfcebface4a Time: 0.0517364 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0xa2121200e08f5391 Time: 0.056125 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xdfa020ef435ef810 Time: 0.0559787 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x5568fd8a32f4a40f Time: 0.0520396 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x8f25d6cdaeaaa100 Time: 0.0520777 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 0xd80cb0f3373aef38 Time: 0.0563688 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x57c9a5ff682354a6 Time: 0.0566613 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x2e9f40fea3fe4d65 Time: 0.0548602 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0xfd2247f786006d58 Time: 0.0570027 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xdb0b80f591d1bb6d Time: 0.0508099 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x5820b3dda403c4d0 Time: 0.0746789 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16 Tactic: 0xb17d53d15dfbfc9e Time: 0.0644632 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x21b295c0c8f6c95a Time: 0.052029 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xe1ff5ad20f5c6bf6 Time: 0.0692419 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0xbb4ac900a7be8b4c Time: 0.050176 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xbd08239a9317f2fd Time: 0.0515901 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa570c55d303796ff Time: 0.0564724 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x4a81ea1e51436a30 Time: 0.0511512 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x0e07ff4f4f7c1ac9 Time: 0.0561356 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x3fc555ff414cee06 Time: 0.0673478 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xc9d24bd069159fa8 Time: 0.0529067 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x454d6448fb6e7fd1 Time: 0.0510537 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0xa1a20ea714d420f4 Time: 0.0673783 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xf79479a62ea9f901 Time: 0.0529143 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xa83b68f30462f971 Time: 0.0551985 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0x834e11ecd4ab9454 Time: 0.0525242 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage4_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x3ca70d6b51bf2164 Time: 0.0541257 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x361d222e42fcb76c Time: 0.050176 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage4_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0xea50b6d3d87bf5dd Time: 0.0558811 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16 Tactic: 0x7005d10718f6c22d Time: 0.0672472 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16 Tactic: 0xd1aaad17ca35fbaa Time: 0.0562712 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x5cf18273fea3db5c Time: 0.0509074 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x2aa016c86360697f Time: 0.0736617 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16_aACCESS Tactic: 0x841c601dec2a75bc Time: 0.0530042 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x9d78040b7e8c8ac7 Time: 0.0512 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage5_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xafd1e8bf6bd3d638 Time: 0.0508099 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage4_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0xf35e0311fa1cc516 Time: 0.050371 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x3e55aa5fb58280dd Time: 0.0640244 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage4_warpsize2x1x2_g1_tensor16x8x16 Tactic: 0x7273dde1d0cd3bd5 Time: 0.0520777 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage5_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0xe69f3e9fcc7b2069 Time: 0.072704 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage3_warpsize4x1x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x3eda3b336995a6f0 Time: 0.0560274 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x64_stage3_warpsize2x2x1_g1_tensor16x8x16_simple_t1r1s1 Tactic: 0x7a738fe099ae3c1e Time: 0.0511025 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage3_warpsize4x2x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x8e1e99c68a674ff4 Time: 0.064128 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage3_warpsize2x2x1_g1_tensor16x8x16 Tactic: 0x866e7a5f6401b67f Time: 0.05632 [07/20/2023-07:26:38] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage3_warpsize2x4x1_g1_tensor16x8x16_t1r1s1 Tactic: 0x23848f7cc4e20635 Time: 0.0677684 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskConvolution[0x80000009]) profiling completed in 0.143906 seconds. Fastest Tactic: 0xbb4ac900a7be8b4c Time: 0.050176 [07/20/2023-07:26:38] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv: 312 available tactics, 0 unparsable, 156 pruned, 156 remaining after tactic pruning. [07/20/2023-07:26:38] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskGemmConvolution[0x8000002e]) [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205c4 Time: 0.0789943 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020848 Time: 0.0798149 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002045d Time: 0.0538789 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020039 Time: 0.0516876 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207bf Time: 0.0838217 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207e4 Time: 0.0842606 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002051a Time: 0.0800023 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020074 Time: 0.0792137 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002097d Time: 0.0514438 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203da Time: 0.0513432 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207ff Time: 0.0823406 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002049d Time: 0.0817189 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002034a Time: 0.0584168 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020873 Time: 0.0602149 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_stages_64x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020056 Time: 0.0882103 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_stages_64x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209aa Time: 0.088064 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_stages_64x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000200dc Time: 0.0854309 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_stages_64x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000200ef Time: 0.0856503 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x64x64_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206ec Time: 0.0490956 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x64x64_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205bd Time: 0.0492008 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020991 Time: 0.0549059 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206ab Time: 0.0553935 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_stages_64x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207f5 Time: 0.0613425 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_stages_64x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002028f Time: 0.0609036 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_stages_64x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208e5 Time: 0.0591086 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_stages_64x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020018 Time: 0.058368 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020170 Time: 0.0846263 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209ac Time: 0.0842606 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020896 Time: 0.0814811 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000202af Time: 0.0821394 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002060d Time: 0.0497951 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002033f Time: 0.0494446 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206fe Time: 0.0498834 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206ea Time: 0.0504274 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000201bd Time: 0.0814811 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020882 Time: 0.0815543 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002015f Time: 0.0790674 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002089a Time: 0.0792869 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x64x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206fc Time: 0.0502796 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x64x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020509 Time: 0.0505661 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208bd Time: 0.056125 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020570 Time: 0.0558385 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020740 Time: 0.0532526 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020773 Time: 0.053248 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020679 Time: 0.052029 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020404 Time: 0.0524678 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_64x4_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208f9 Time: 0.0504686 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_64x4_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020624 Time: 0.0508099 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002010c Time: 0.08448 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020359 Time: 0.08448 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207d7 Time: 0.0569539 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206e7 Time: 0.0547109 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f6 Time: 0.0559299 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206e2 Time: 0.0552533 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002055e Time: 0.0549623 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002009e Time: 0.0550522 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000208bc Time: 0.0572952 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209a5 Time: 0.0573943 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002084d Time: 0.0849189 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205bb Time: 0.0857234 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000201ba Time: 0.058173 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207e6 Time: 0.0589547 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x32x64_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000205e3 Time: 0.0729234 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x32x64_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020614 Time: 0.0729966 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000206f5 Time: 0.0624183 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020095 Time: 0.0627566 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020886 Time: 0.0851383 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020075 Time: 0.0874057 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020749 Time: 0.0639192 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207eb Time: 0.0656442 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm86_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002064c Time: 0.0649509 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm86_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x128x32_stage2_warpsize4x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000203f4 Time: 0.0706072 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize32x32x64_stage6_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020487 Time: 0.0780434 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize32x32x64_stage6_warpsize2x2x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020144 Time: 0.0861623 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x64_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020988 Time: 0.101099 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x64_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020735 Time: 0.099328 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x64_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002090c Time: 0.0732891 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x64_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002080f Time: 0.0755566 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_stages_32x3_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207b9 Time: 0.0950057 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_stages_32x3_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209e3 Time: 0.0955246 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x256x32_stage3_warpsize2x4x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020604 Time: 0.0666712 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x256x32_stage3_warpsize2x4x1_tensor16x8x16 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020427 Time: 0.0652434 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_relu_stages_32x3_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020957 Time: 0.0679741 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_relu_stages_32x3_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000207fa Time: 0.0684678 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407e4 Time: 0.0989623 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407bf Time: 0.0986697 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020405c4 Time: 0.0994011 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040848 Time: 0.101083 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204049d Time: 0.101888 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407ff Time: 0.101815 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204051a Time: 0.1024 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040074 Time: 0.102766 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040039 Time: 0.0710949 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204045d Time: 0.0734354 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204034a Time: 0.0730697 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040873 Time: 0.0738011 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204097d Time: 0.074624 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020403da Time: 0.0748251 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406ab Time: 0.0745326 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_sliced1x2_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040991 Time: 0.0740206 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002073e Time: 0.0997669 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x000000000002031d Time: 0.096832 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_stages_64x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040056 Time: 0.119589 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_stages_64x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020400dc Time: 0.11755 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_stages_64x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020400ef Time: 0.117749 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_stages_64x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020409aa Time: 0.119954 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x64x64_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406ec Time: 0.0883566 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x64x64_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020405bd Time: 0.0894537 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020409ac Time: 0.110795 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_32x6_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040170 Time: 0.111543 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020402af Time: 0.101449 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_32x6_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040896 Time: 0.102985 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204060d Time: 0.0983771 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize64x128x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204033f Time: 0.0981577 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406fe Time: 0.10123 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x64x32_stage5_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406ea Time: 0.10101 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040882 Time: 0.111918 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_stages_64x4_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020401bd Time: 0.112128 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_64x4_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204089a Time: 0.101961 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_stages_64x4_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204015f Time: 0.101449 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x64x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406fc Time: 0.0772274 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x64x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040509 Time: 0.0785554 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_stages_64x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407f5 Time: 0.092672 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_sliced1x2_ldg8_relu_stages_64x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204028f Time: 0.0932571 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_relu_tn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x0000000000020512 Time: 0.0726309 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_256x128_ldg8_relu_nn_v1 numSplitK: 1 numBuffers: 0 numKernels: 1 Tactic: 0x00000000000209c5 Time: 0.0697295 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040570 Time: 0.0831634 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_32x6_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020408bd Time: 0.083104 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040773 Time: 0.0842446 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x128_ldg8_relu_stages_64x4_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040740 Time: 0.0844069 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_stages_64x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020408e5 Time: 0.0904777 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_64x64_ldg8_relu_stages_64x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040018 Time: 0.0906971 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040679 Time: 0.0725211 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_32x6_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040404 Time: 0.0739474 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_64x4_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020408f9 Time: 0.0732891 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x64_ldg8_relu_stages_64x4_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040624 Time: 0.0735086 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204010c Time: 0.104448 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_stages_32x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040359 Time: 0.105326 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407d7 Time: 0.102912 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x32_stage4_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406e7 Time: 0.103486 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406e2 Time: 0.10379 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x64x32_stage3_warpsize4x1x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406f6 Time: 0.103863 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204009e Time: 0.0727771 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize128x128x64_stage3_warpsize2x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204055e Time: 0.0731428 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020409a5 Time: 0.0776046 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_stages_32x5_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020408bc Time: 0.077824 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x000000000204084d Time: 0.103717 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020405bb Time: 0.104448 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020401ba Time: 0.0757691 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x128_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407e6 Time: 0.0771657 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_tn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040095 Time: 0.108325 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: sm80_xmma_gemm_f16f16_f16f16_f16_nn_n_tilesize256x128x32_stage3_warpsize4x2x1_tensor16x8x16 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020406f5 Time: 0.107241 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040075 Time: 0.0984343 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040886 Time: 0.0964023 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_relu_nn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x0000000002040749 Time: 0.0725623 [07/20/2023-07:26:39] [V] [TRT] Tactic Name: ampere_h16816gemm_128x256_ldg8_relu_tn_v1 numSplitK: 2 numBuffers: 1 numKernels: 1 Tactic: 0x00000000020407eb Time: 0.0738743 [07/20/2023-07:26:39] [V] [TRT] /encoder_embed/convnext/pointwise_conv2/Conv (CaskGemmConvolution[0x8000002e]) profiling completed in 0.999258 seconds. Fastest Tactic: 0x00000000000206ec Time: 0.0490956 [07/20/2023-07:26:39] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:39] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:39] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskGemmConvolution Tactic: 0x00000000000206ec [07/20/2023-07:26:39] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 456 (CEIL_DIV (+ T -6) 2) -456),1:16,456,24) -> Half((MUL_ADD 152 (CEIL_DIV (+ T -6) 2) -152),1:16,152,8) where E0=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:39] [V] [TRT] --------------- Timing Runner: /encoder_embed/convnext/pointwise_conv2/Conv (CublasConvolution[0x80000029]) [07/20/2023-07:26:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:39] [V] [TRT] =============== Computing costs for [trainStation2] [07/20/2023-07:26:39] [V] [TRT] *************** Autotuning format combination: -> *************** [07/20/2023-07:26:39] [V] [TRT] --------------- Timing Runner: [trainStation2] (TrainStation[0x80000032]) [07/20/2023-07:26:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.000349832 [07/20/2023-07:26:39] [V] [TRT] [trainStation2] (TrainStation[0x80000032]) profiling completed in 0.0106839 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.000349832 [07/20/2023-07:26:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: TrainStation Tactic: 0x0000000000000000 [07/20/2023-07:26:39] [V] [TRT] =============== Computing costs for {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} [07/20/2023-07:26:39] [V] [TRT] *************** Autotuning format combination: Int32(1), Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2), Float((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2), Int32() -> Float((* 192 N),192,1), Float((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0), Float((* 192 N),192,1), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) E2=(MUL_ADD 2432 E0 -2432) E3=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E4=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E5=(* (MIN E3 (MIN 1 (# 0 E4))) (MAX E3 (# 0 E4))) E6=(RESHAPE N E5 | N 1 E5) E7=(+ E0 -1) E8=(+ (+ E0 4998) (+ E0 -5001)) E9=(* E7 E7) E10=(* 192 N) *************** [07/20/2023-07:26:39] [V] [TRT] --------------- Timing Runner: {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:26:45] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:26:45] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:26:45] [V] [TRT] (foreignNode) Enable Runtime Tensor Allocation (RTA), as Static Tensor Allocation failed. [07/20/2023-07:26:45] [V] [TRT] (foreignNode) Set is_stream_capturable to false, as some tensors will be runtime allocated. [07/20/2023-07:26:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.629175 [07/20/2023-07:26:45] [V] [TRT] {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 5.8783 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.629175 [07/20/2023-07:26:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:26:45] [V] [TRT] *************** Autotuning format combination: Int32(1), Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2), Half((MUL_ADD 2432 E0 -2432),(MUL_ADD 19 E0 -19),19,1) where E0=(CEIL_DIV (+ T -6) 2), Int32() -> Half((* 192 N),192,1), Half((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0), Half((* 192 N),192,1), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 19 E0 -19) E2=(MUL_ADD 2432 E0 -2432) E3=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E4=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E5=(* (MIN E3 (MIN 1 (# 0 E4))) (MAX E3 (# 0 E4))) E6=(RESHAPE N E5 | N 1 E5) E7=(+ E0 -1) E8=(+ (+ E0 4998) (+ E0 -5001)) E9=(* E7 E7) E10=(* 192 N) *************** [07/20/2023-07:26:45] [V] [TRT] --------------- Timing Runner: {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:26:51] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:26:51] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:26:51] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.211675 [07/20/2023-07:26:51] [V] [TRT] {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.06687 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.211675 [07/20/2023-07:26:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:26:51] [V] [TRT] *************** Autotuning format combination: Int32(1), Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16), Half((MUL_ADD 304 (CEIL_DIV (+ T -6) 2) -304),1:8,304,16), Int32() -> Float((* 192 N),192,1), Float((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((* E2 E3),1:8,E3,E1) where E0=(CEIL_DIV (+ T -6) 2) E1=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 4998) (+ E0 -5001)) 16 | -1 (MUL_ADD 2 E0 -3) 4 4 zeroIsPlaceholder))) 8) E2=(+ E0 -1) E3=(* E2 E1), Float((* 192 N),192,1), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MUL_ADD 304 E1 -304) E1=(CEIL_DIV (+ T -6) 2) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(+ (+ E1 4998) (+ E1 -5001)) E7=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 E6 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) 8) E8=(+ E1 -1) E9=(* E8 E7) E10=(* 192 N) *************** [07/20/2023-07:26:51] [V] [TRT] --------------- Timing Runner: {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:26:57] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:26:57] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.242249 [07/20/2023-07:26:58] [V] [TRT] {ForeignNode[/Unsqueeze_3...(Unnamed Layer* 839) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.26528 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.242249 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] =============== Computing costs for [ShapeHostToDeviceCopy 5579] [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: -> Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32(), Int32() *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: [ShapeHostToDeviceCopy 5579] (ShapeHostToDevice[0x80000024]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0437794 [07/20/2023-07:26:58] [V] [TRT] [ShapeHostToDeviceCopy 5579] (ShapeHostToDevice[0x80000024]) profiling completed in 0.00209267 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0437794 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ShapeHostToDevice Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448786 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027744 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00404292 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00448786 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 48 E0 -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00564255 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00224945 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00564255 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433745 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027696 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00401914 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00433745 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00600114 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00246459 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00600114 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00474411 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0248975 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00361587 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00474411 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 6 E0 -6) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00457629 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.024893 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00360986 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00457629 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00468911 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0280358 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00375849 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00468911 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00542324 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00233061 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00542324 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 24 E0 -24) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00530066 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00235547 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00530066 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00448671 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0255269 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00366332 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00448671 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00591909 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0023305 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00591909 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00429553 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0251855 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00381123 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00429553 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00433011 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027843 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00394863 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00433011 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00590153 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00240642 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00590153 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437209 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0275505 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00410668 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00437209 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) -> Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443484 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0269844 [07/20/2023-07:26:58] [V] [TRT] shuffle_between_(Unnamed Layer* 839) [Shuffle]_output_and_/encoder/0/layers.0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00383115 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00443484 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] =============== Computing costs for /encoder/0/layers.0/conv_module1/depthwise_conv/Conv [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 2.48057 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 2.30707 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 1.97486 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 2.2825 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize128x32_threadsize64x4_general Tactic: 0x02aff33b8cd106c8 Time: 0.0306551 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xa9366041633a5135 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 1.36397 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xcb8a43f748d8a338 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 1.03629 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x5aa723e0481da855 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 1.43667 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x8_threadsize32x4 Tactic: 0xd1a22ad13e727070 Time: 0.0153275 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x40a12e3938221818 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 1.21037 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xb0bf940d5e0f9f45 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 1.01171 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xd828f024626fa982 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 1.11821 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x9d9fdb5fd9945f64 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 1.14893 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize32x8_threadsize32x4_general Tactic: 0x93ba18009b18a330 Time: 0.0124324 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f32f32_f32_f32_nchwkcrs_nchw Tactic: 0x0ab370a6aeef128c Time: 0.00723954 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xa8609adc4e0ceb90 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 1.94682 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xf64396b97c889179 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 2.3511 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x12dbf7d94ee3696d which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 1.55549 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x16_threadsize64x2 Tactic: 0x36688904578c3005 Time: 0.0355182 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_generic Tactic: 0xc9d0e04a5184cb3e Time: 0.017567 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm70_xmma_convolution_depthwiseConv_fp32fp32_trt_kernel_fp32_TR_TS Tactic: 0x9934205e4f120728 Time: 0.0105326 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xa31d27de74b895ff which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 1.12742 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize128x8_threadsize128x1 Tactic: 0x966f5e7809fca289 Time: 0.0355474 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize64x8_threadsize64x2_general Tactic: 0x00753944b0df80b7 Time: 0.0144562 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xbb8c3889c7eacd30 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 3.39866 [07/20/2023-07:26:58] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.390563 seconds. Fastest Tactic: 0x0ab370a6aeef128c Time: 0.00723954 [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0ab370a6aeef128c [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 2.94488 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 0.878885 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x92ed3100c35fc43e which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 2.83341 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x8014228ec08b4d49 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 8.21862 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x1da91d865428f237 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 4.69299 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x4fd3c46622e98342 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 3.33619 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 0.968265 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x7121ec1db3f80c67 which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 2.04698 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x0a143be7a52f301a which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 2.21594 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0x62835fce994f06dd which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 2.98496 [07/20/2023-07:26:58] [V] [TRT] Fast skip Tactic:0xa6448a1e79f1ca6f which exceed time limit during pre-run [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 3.39149 [07/20/2023-07:26:58] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.218253 seconds. Fastest Tactic: 0xcf8ea142095f02d2 Time: 0.878885 [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xcf8ea142095f02d2 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize64x8_threadsize64x2_general_alignC4 Tactic: 0xf7bc7502ac7dff9b Time: 0.0196434 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize128x32_threadsize64x4_general_alignC4 Tactic: 0x5d176f6a3900f1fd Time: 0.0270629 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_convolution_trt_depthwiseFP32NHWC4_fp32nhwcx4_fp32nhwcx4_fp32kcrs Tactic: 0x2cac8ad6921b6398 Time: 0.0213995 [07/20/2023-07:26:58] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00786791 seconds. Fastest Tactic: 0xf7bc7502ac7dff9b Time: 0.0196434 [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf7bc7502ac7dff9b [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f16f16_f16_f16_nchwkcrs_nchw Tactic: 0x0eee0204592bd97f Time: 0.00473335 [07/20/2023-07:26:58] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.003654 seconds. Fastest Tactic: 0x0eee0204592bd97f Time: 0.00473335 [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:26:58] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0eee0204592bd97f [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f16f16_f16_f16_ndhwcktrsc_ndhwc_tilesize64x16_threadsize64x2_general_alignC8 Tactic: 0x004bc40835df5b89 Time: 0.0126781 [07/20/2023-07:26:58] [V] [TRT] Tactic Name: sm50_xmma_convolution_depthwiseHMMA_FP16NHWCx8_TR_TS_STRIDEH_STRIDEW Tactic: 0x64275a11c9ed1722 Time: 0.0203886 [07/20/2023-07:26:58] [V] [TRT] /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00481354 seconds. Fastest Tactic: 0x004bc40835df5b89 Time: 0.0126781 [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:26:58] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x004bc40835df5b89 [07/20/2023-07:26:58] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 840) [Convolution]_output [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0042997 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.028285 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00420193 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0042997 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00988891 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00212765 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00988891 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.012115 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0254537 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00358767 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.012115 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00602248 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00236397 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00602248 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0122522 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0267459 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00357216 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0122522 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 6 E1 -6) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432984 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0263749 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00384553 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00432984 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422494 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0277653 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00383995 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00422494 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00990568 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00197382 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00990568 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00991756 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00196582 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00991756 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 96 E1 -96) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00423691 [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0275992 [07/20/2023-07:26:58] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00383939 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00423691 [07/20/2023-07:26:58] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:58] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 96 E1 -96) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:58] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:58] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0058624 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00246221 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0058624 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00736366 [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0295017 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00400258 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00736366 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.007224 [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0278187 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00402744 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.007224 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00586953 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00246641 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00586953 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00729874 [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0261821 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0038871 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00729874 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) -> Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00748274 [07/20/2023-07:26:59] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0269653 [07/20/2023-07:26:59] [V] [TRT] shuffle_after_(Unnamed Layer* 840) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00397518 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00748274 [07/20/2023-07:26:59] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:26:59] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} [07/20/2023-07:26:59] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Float((* 192 N),192,1), Float((* 192 N),192,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0) -> Float((* 192 N),192,1), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(* E6 E6) E8=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:26:59] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:01] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:01] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.116224 [07/20/2023-07:27:01] [V] [TRT] {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.37258 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.116224 [07/20/2023-07:27:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:01] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Half((* 192 N),192,1), Half((* 192 N),192,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0) -> Half((* 192 N),192,1), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(* E6 E6) E8=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:27:01] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:03] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:03] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:04] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.082944 [07/20/2023-07:27:04] [V] [TRT] {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.62719 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.082944 [07/20/2023-07:27:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:04] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24), Float((* 192 N),192,1), Float((* 192 N),192,1), Half((* E2 E3),1:8,E3,E1) where E0=(CEIL_DIV (+ T -6) 2) E1=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 4998) (+ E0 -5001)) 16 | -1 (MUL_ADD 2 E0 -3) 4 4 zeroIsPlaceholder))) 8) E2=(+ E0 -1) E3=(* E2 E1) -> Float((* 192 N),192,1), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(* 192 N) E5=(CEIL_DIV (+ T -6) 2) E6=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E5 4998) (+ E5 -5001)) 16 | -1 (MUL_ADD 2 E5 -3) 4 4 zeroIsPlaceholder))) 8) E7=(+ E5 -1) E8=(* E7 E6) E9=(MUL_ADD 24 E5 -24) *************** [07/20/2023-07:27:04] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:06] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:06] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0893806 [07/20/2023-07:27:06] [V] [TRT] {ForeignNode[/encoder/0/layers.0/conv_module2/Expand...(Unnamed Layer* 1041) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.77024 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0893806 [07/20/2023-07:27:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:06] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 1041) [Shuffle]_output_and_/encoder/0/layers.0/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 48 E0 -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 6 E0 -6) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 24 E0 -24) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) -> Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:06] [V] [TRT] =============== Computing costs for /encoder/0/layers.0/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:06] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:06] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:06] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 1042) [Convolution]_output [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 6 E1 -6) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 96 E1 -96) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 96 E1 -96) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) -> Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:06] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} [07/20/2023-07:27:06] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Float((* 192 N),192,1), Float((* 192 N),192,1), Float((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Int32() -> Float((* 192 N),192,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0), Float((* 192 N),192,1), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(+ (+ E4 4998) (+ E4 -5001)) E8=(* E6 E6) E9=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:27:06] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:11] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:11] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:11] [V] [TRT] (foreignNode) Enable Runtime Tensor Allocation (RTA), as Static Tensor Allocation failed. [07/20/2023-07:27:11] [V] [TRT] (foreignNode) Set is_stream_capturable to false, as some tensors will be runtime allocated. [07/20/2023-07:27:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.595822 [07/20/2023-07:27:12] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 5.45165 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.595822 [07/20/2023-07:27:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:12] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Half((* 192 N),192,1), Half((* 192 N),192,1), Half((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Int32() -> Half((* 192 N),192,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0), Half((* 192 N),192,1), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(+ (+ E4 4998) (+ E4 -5001)) E8=(* E6 E6) E9=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:27:12] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:17] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:17] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:18] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.180078 [07/20/2023-07:27:18] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.04016 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.180078 [07/20/2023-07:27:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:18] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24), Float((* 192 N),192,1), Float((* 192 N),192,1), Float((* 48 (+ (+ E0 4998) (+ E0 -5001))),48,1) where E0=(CEIL_DIV (+ T -6) 2), Int32() -> Float((* 192 N),192,1), Half((* E2 E3),1:8,E3,E1) where E0=(CEIL_DIV (+ T -6) 2) E1=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 4998) (+ E0 -5001)) 16 | -1 (MUL_ADD 2 E0 -3) 4 4 zeroIsPlaceholder))) 8) E2=(+ E0 -1) E3=(* E2 E1), Float((* 192 N),192,1), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(* 192 N) E5=(CEIL_DIV (+ T -6) 2) E6=(+ (+ E5 4998) (+ E5 -5001)) E7=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 E6 16 | -1 (MUL_ADD 2 E5 -3) 4 4 zeroIsPlaceholder))) 8) E8=(+ E5 -1) E9=(* E8 E7) E10=(MUL_ADD 24 E5 -24) *************** [07/20/2023-07:27:18] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:23] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:23] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:24] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.212407 [07/20/2023-07:27:24] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module1/Expand...(Unnamed Layer* 1682) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.24132 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.212407 [07/20/2023-07:27:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:24] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 1682) [Shuffle]_output_and_/encoder/0/layers.1/conv_module1/depthwise_conv/Conv [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 48 E0 -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 6 E0 -6) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 24 E0 -24) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) -> Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:24] [V] [TRT] =============== Computing costs for /encoder/0/layers.1/conv_module1/depthwise_conv/Conv [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:24] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:24] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:24] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:24] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:24] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:24] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 1683) [Convolution]_output [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 6 E1 -6) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 96 E1 -96) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 96 E1 -96) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) -> Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:24] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} [07/20/2023-07:27:24] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Float((* 192 N),192,1), Float((* 192 N),192,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0) -> Float((* 192 N),192,1), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(* E6 E6) E8=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:27:24] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:25] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:25] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.115419 [07/20/2023-07:27:25] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 1.34316 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.115419 [07/20/2023-07:27:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:25] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Half((* 192 N),192,1), Half((* 192 N),192,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E1 4998) (+ E1 -5001)) 16 | -1 (MUL_ADD 2 E1 -3) 4 4 zeroIsPlaceholder))) E2),E2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(* E0 E0) -> Half((* 192 N),192,1), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(CEIL_DIV (+ T -6) 2) E5=(* 192 N) E6=(+ E4 -1) E7=(* E6 E6) E8=(MUL_ADD 192 E4 -192) *************** [07/20/2023-07:27:25] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:27] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:27] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:27] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0827246 [07/20/2023-07:27:27] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 1.54988 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0827246 [07/20/2023-07:27:27] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:27] [V] [TRT] *************** Autotuning format combination: Bool((# 2 E3),(# 2 E3),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24), Float((* 192 N),192,1), Float((* 192 N),192,1), Half((* E2 E3),1:8,E3,E1) where E0=(CEIL_DIV (+ T -6) 2) E1=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 4998) (+ E0 -5001)) 16 | -1 (MUL_ADD 2 E0 -3) 4 4 zeroIsPlaceholder))) 8) E2=(+ E0 -1) E3=(* E2 E1) -> Float((* 192 N),192,1), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(RESHAPE N E2 | N 1 E2) E4=(* 192 N) E5=(CEIL_DIV (+ T -6) 2) E6=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E5 4998) (+ E5 -5001)) 16 | -1 (MUL_ADD 2 E5 -3) 4 4 zeroIsPlaceholder))) 8) E7=(+ E5 -1) E8=(* E7 E6) E9=(MUL_ADD 24 E5 -24) *************** [07/20/2023-07:27:27] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:28] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:28] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:29] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0897463 [07/20/2023-07:27:29] [V] [TRT] {ForeignNode[/encoder/0/layers.1/conv_module2/Expand...(Unnamed Layer* 1884) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 1.75912 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0897463 [07/20/2023-07:27:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:29] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 1884) [Shuffle]_output_and_/encoder/0/layers.1/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 48 E0 -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 6 E0 -6) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 192 E0 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(CEIL_DIV (+ T -6) 2) E1=(MUL_ADD 24 E0 -24) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) E2=(MUL_ADD 96 E0 -96) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(CEIL_DIV (+ T -6) 2) E1=(+ E0 -1) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) -> Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:29] [V] [TRT] =============== Computing costs for /encoder/0/layers.1/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) E2=(+ E1 -1) *************** [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:29] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: /encoder/0/layers.1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:29] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:29] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 1885) [Convolution]_output [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1,E0,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) -> Float((MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192),1,192,192) where E0=(MUL_ADD 192 (CEIL_DIV (+ T -6) 2) -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 48 E1 -48) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Float((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Float((MUL_ADD 6 E1 -6),E0:32,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Float((MUL_ADD 6 E0 -6),(+ E0 -1):32,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 6 E1 -6) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 192 E1 -192) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 192 E1 -192),E0,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half((MUL_ADD 96 E1 -96),E0:2,E0,1) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) -> Half((MUL_ADD 96 E0 -96),(+ E0 -1):2,1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(+ E1 -1) E1=(CEIL_DIV (+ T -6) 2) E2=(MUL_ADD 96 E1 -96) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 96 E1 -96) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:2,E0,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) -> Half((MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96),1:2,96,96) where E0=(MUL_ADD 96 (CEIL_DIV (+ T -6) 2) -96) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:4,E0,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) -> Half((MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48),1:4,48,48) where E0=(MUL_ADD 48 (CEIL_DIV (+ T -6) 2) -48) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2) where E0=(MUL_ADD 24 E1 -24) E1=(CEIL_DIV (+ T -6) 2) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:8,E0,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) -> Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24) where E0=(MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24) *************** [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Half(E0,1:16,E0,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) -> Half((MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12),1:16,12,12) where E0=(MUL_ADD 12 (CEIL_DIV (+ T -6) 2) -12) *************** [07/20/2023-07:27:29] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} [07/20/2023-07:27:29] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Float((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Float((* 192 N),192,1), Float((* 192 N),192,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E10), Float((* 256 N),256,1), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(CEIL_DIV (+ T -6) 2) E3=(* 192 N) E4=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E5=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E4) E4) 2))) E6=(* 256 N) E7=(CEIL_DIV (+ T -8) 4) E8=(+ E2 -1) E9=(RESHAPE N E4 | N 1 E4) E10=(MIN 1 (# 2 E9)) E11=(BROADCAST_SIZE E8 (* (MAX (# 2 E9) E8) E10)) E12=(BROADCAST_SIZE E8 (BROADCAST_SIZE E11 (* E10 (MAX (# 2 E9) E11)))) E13=(BROADCAST_SIZE E12 (* E10 (MAX (# 2 E9) E12))) E14=(CEIL_DIV (BROADCAST_SIZE E12 (BROADCAST_SIZE E13 (* E10 (MAX (# 2 E9) E13)))) 2) E15=(+ (+ E7 -5000) (+ E7 4999)) E16=(* E14 E7) *************** [07/20/2023-07:27:29] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:34] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:34] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:34] [V] [TRT] (foreignNode) Enable Runtime Tensor Allocation (RTA), as Static Tensor Allocation failed. [07/20/2023-07:27:34] [V] [TRT] (foreignNode) Set is_stream_capturable to false, as some tensors will be runtime allocated. [07/20/2023-07:27:34] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.262875 [07/20/2023-07:27:34] [V] [TRT] {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 5.61396 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.262875 [07/20/2023-07:27:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:34] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Half((MUL_ADD 192 E0 -192),(+ E0 -1),1,1) where E0=(CEIL_DIV (+ T -6) 2), Half((* 192 N),192,1), Half((* 192 N),192,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 256 N),256,1), Half((* 256 N),256,1), Half((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E10), Half((* 256 N),256,1), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(CEIL_DIV (+ T -6) 2) E3=(* 192 N) E4=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E5=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E4) E4) 2))) E6=(* 256 N) E7=(CEIL_DIV (+ T -8) 4) E8=(+ E2 -1) E9=(RESHAPE N E4 | N 1 E4) E10=(MIN 1 (# 2 E9)) E11=(BROADCAST_SIZE E8 (* (MAX (# 2 E9) E8) E10)) E12=(BROADCAST_SIZE E8 (BROADCAST_SIZE E11 (* E10 (MAX (# 2 E9) E11)))) E13=(BROADCAST_SIZE E12 (* E10 (MAX (# 2 E9) E12))) E14=(CEIL_DIV (BROADCAST_SIZE E12 (BROADCAST_SIZE E13 (* E10 (MAX (# 2 E9) E13)))) 2) E15=(+ (+ E7 -5000) (+ E7 4999)) E16=(* E14 E7) *************** [07/20/2023-07:27:34] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:40] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:40] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:40] [V] [TRT] (foreignNode) Enable Runtime Tensor Allocation (RTA), as Static Tensor Allocation failed. [07/20/2023-07:27:40] [V] [TRT] (foreignNode) Set is_stream_capturable to false, as some tensors will be runtime allocated. [07/20/2023-07:27:41] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.220745 [07/20/2023-07:27:41] [V] [TRT] {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.42788 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.220745 [07/20/2023-07:27:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:41] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Half((MUL_ADD 24 (CEIL_DIV (+ T -6) 2) -24),1:8,24,24), Float((* 192 N),192,1), Float((* 192 N),192,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Half((* E0 E11),1:8,E11,E10) where E0=(CEIL_DIV (+ T -8) 4) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E0 -1) 4 4 zeroIsPlaceholder))) 8) E11=(* (CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E10), Float((* 256 N),256,1), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* 192 N) E3=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E4=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 2))) E5=(* 256 N) E6=(CEIL_DIV (+ T -8) 4) E7=(+ (+ E6 -5000) (+ E6 4999)) E8=(CEIL_DIV (+ T -6) 2) E9=(+ E8 -1) E10=(RESHAPE N E3 | N 1 E3) E11=(MIN 1 (# 2 E10)) E12=(BROADCAST_SIZE E9 (* (MAX (# 2 E10) E9) E11)) E13=(BROADCAST_SIZE E9 (BROADCAST_SIZE E12 (* E11 (MAX (# 2 E10) E12)))) E14=(BROADCAST_SIZE E13 (* E11 (MAX (# 2 E10) E13))) E15=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 E7 16 | -1 (MUL_ADD 2 E6 -1) 4 4 zeroIsPlaceholder))) 8) E16=(* E17 E15) E17=(CEIL_DIV (BROADCAST_SIZE E13 (BROADCAST_SIZE E14 (* E11 (MAX (# 2 E10) E14)))) 2) *************** [07/20/2023-07:27:41] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:47] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:47] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:47] [V] [TRT] (foreignNode) Enable Runtime Tensor Allocation (RTA), as Static Tensor Allocation failed. [07/20/2023-07:27:47] [V] [TRT] (foreignNode) Set is_stream_capturable to false, as some tensors will be runtime allocated. [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.556032 [07/20/2023-07:27:48] [V] [TRT] {ForeignNode[/encoder/Slice_1...(Unnamed Layer* 2715) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.71001 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.556032 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437472 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0262339 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00416582 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00437472 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 64 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00489859 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00211119 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00489859 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426259 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.025939 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.004022 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00426259 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446757 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00203759 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00446757 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00467215 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0254979 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00362343 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00467215 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434964 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0276998 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00377366 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00434964 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00422265 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0273554 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00379581 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00422265 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00485349 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00245316 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00485349 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 32 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00482088 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00187035 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00482088 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00426541 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027008 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00383948 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00426541 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428222 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00206613 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00428222 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424067 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0251611 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00371423 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00424067 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.004466 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0252076 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00363784 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.004466 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00432511 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00208381 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00432511 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424242 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0258423 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0037377 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00424242 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00441697 [07/20/2023-07:27:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0264046 [07/20/2023-07:27:48] [V] [TRT] shuffle_between_(Unnamed Layer* 2715) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00366543 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00441697 [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:48] [V] [TRT] =============== Computing costs for /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 3.31279 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 2.99447 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 2.59218 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 3.03735 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize128x32_threadsize64x4_general Tactic: 0x02aff33b8cd106c8 Time: 0.0282088 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xa9366041633a5135 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 1.79507 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xcb8a43f748d8a338 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 1.3271 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x5aa723e0481da855 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 1.95174 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x8_threadsize32x4 Tactic: 0xd1a22ad13e727070 Time: 0.0136844 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x40a12e3938221818 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 1.6128 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xb0bf940d5e0f9f45 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 1.29946 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xd828f024626fa982 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 1.48992 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x9d9fdb5fd9945f64 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 1.50835 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize32x8_threadsize32x4_general Tactic: 0x93ba18009b18a330 Time: 0.0103236 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f32f32_f32_f32_nchwkcrs_nchw Tactic: 0x0ab370a6aeef128c Time: 0.00568176 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xa8609adc4e0ceb90 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 2.60506 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xf64396b97c889179 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 3.0936 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x12dbf7d94ee3696d which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 2.07386 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x16_threadsize64x2 Tactic: 0x36688904578c3005 Time: 0.0343771 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_generic Tactic: 0xc9d0e04a5184cb3e Time: 0.0124701 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm70_xmma_convolution_depthwiseConv_fp32fp32_trt_kernel_fp32_TR_TS Tactic: 0x9934205e4f120728 Time: 0.00893 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xa31d27de74b895ff which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 1.50221 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize128x8_threadsize128x1 Tactic: 0x966f5e7809fca289 Time: 0.0343186 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize64x8_threadsize64x2_general Tactic: 0x00753944b0df80b7 Time: 0.011181 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xbb8c3889c7eacd30 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 4.54042 [07/20/2023-07:27:48] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.464573 seconds. Fastest Tactic: 0x0ab370a6aeef128c Time: 0.00568176 [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:27:48] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0ab370a6aeef128c [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 3.92631 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 1.16195 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x92ed3100c35fc43e which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 3.76832 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x8014228ec08b4d49 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 10.9466 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x1da91d865428f237 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 6.23104 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x4fd3c46622e98342 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 4.4288 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 1.28132 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x7121ec1db3f80c67 which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 2.72896 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x0a143be7a52f301a which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 2.95424 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0x62835fce994f06dd which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 3.98234 [07/20/2023-07:27:48] [V] [TRT] Fast skip Tactic:0xa6448a1e79f1ca6f which exceed time limit during pre-run [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 4.48922 [07/20/2023-07:27:48] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.287316 seconds. Fastest Tactic: 0xcf8ea142095f02d2 Time: 1.16195 [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xcf8ea142095f02d2 [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize64x8_threadsize64x2_general_alignC4 Tactic: 0xf7bc7502ac7dff9b Time: 0.0139898 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize128x32_threadsize64x4_general_alignC4 Tactic: 0x5d176f6a3900f1fd Time: 0.0244968 [07/20/2023-07:27:48] [V] [TRT] Tactic Name: sm50_xmma_convolution_trt_depthwiseFP32NHWC4_fp32nhwcx4_fp32nhwcx4_fp32kcrs Tactic: 0x2cac8ad6921b6398 Time: 0.0151547 [07/20/2023-07:27:48] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00784135 seconds. Fastest Tactic: 0xf7bc7502ac7dff9b Time: 0.0139898 [07/20/2023-07:27:48] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf7bc7502ac7dff9b [07/20/2023-07:27:48] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:49] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f16f16_f16_f16_nchwkcrs_nchw Tactic: 0x0eee0204592bd97f Time: 0.00440935 [07/20/2023-07:27:49] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00378638 seconds. Fastest Tactic: 0x0eee0204592bd97f Time: 0.00440935 [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:49] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:27:49] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0eee0204592bd97f [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:49] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:49] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:49] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:49] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:49] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f16f16_f16_f16_ndhwcktrsc_ndhwc_tilesize64x16_threadsize64x2_general_alignC8 Tactic: 0x004bc40835df5b89 Time: 0.00979992 [07/20/2023-07:27:49] [V] [TRT] Tactic Name: sm50_xmma_convolution_depthwiseHMMA_FP16NHWCx8_TR_TS_STRIDEH_STRIDEW Tactic: 0x64275a11c9ed1722 Time: 0.0147895 [07/20/2023-07:27:49] [V] [TRT] /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00490047 seconds. Fastest Tactic: 0x004bc40835df5b89 Time: 0.00979992 [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:49] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x004bc40835df5b89 [07/20/2023-07:27:49] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 2716) [Convolution]_output [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00396195 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0261364 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00402252 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00396195 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00732183 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00228966 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00732183 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00816127 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027965 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00392545 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00816127 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00461449 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0020509 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00461449 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00836013 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027648 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0038977 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00836013 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00425358 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0246469 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00372297 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00425358 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00409809 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0273798 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00383119 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00409809 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00749668 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00225227 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00749668 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0075301 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0021065 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0075301 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00404381 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0245326 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00370365 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00404381 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00417959 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00210483 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00417959 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0051853 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0261364 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00401201 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0051853 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00530336 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.025405 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00393381 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00530336 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00419148 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00204461 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00419148 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00533029 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.025379 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00399916 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00533029 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00527804 [07/20/2023-07:27:49] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0258438 [07/20/2023-07:27:49] [V] [TRT] shuffle_after_(Unnamed Layer* 2716) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00411247 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00527804 [07/20/2023-07:27:49] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:27:49] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} [07/20/2023-07:27:49] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E10) -> Float((* 256 N),256,1), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(* E10 E12) E14=(* 256 E10) *************** [07/20/2023-07:27:49] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:50] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:50] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:51] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.100791 [07/20/2023-07:27:51] [V] [TRT] {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.0502 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.100791 [07/20/2023-07:27:51] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:51] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Half((* 256 N),256,1), Half((* 256 N),256,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E10) -> Half((* 256 N),256,1), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(* E10 E12) E14=(* 256 E10) *************** [07/20/2023-07:27:51] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:53] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:53] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:53] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.078848 [07/20/2023-07:27:53] [V] [TRT] {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.40782 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.078848 [07/20/2023-07:27:53] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:53] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))), Float((* 256 N),256,1), Float((* 256 N),256,1), Half((* E0 E11),1:8,E11,E10) where E0=(CEIL_DIV (+ T -8) 4) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E0 -1) 4 4 zeroIsPlaceholder))) 8) E11=(* (CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E10) -> Float((* 256 N),256,1), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(* 256 N) E11=(CEIL_DIV (+ T -8) 4) E12=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E13=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E11 -5000) (+ E11 4999)) 16 | -1 (MUL_ADD 2 E11 -1) 4 4 zeroIsPlaceholder))) 8) E14=(* E12 E13) E15=(* 32 E12) *************** [07/20/2023-07:27:53] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:27:55] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:27:55] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:27:56] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.082944 [07/20/2023-07:27:56] [V] [TRT] {ForeignNode[/encoder/1/encoder/0/conv_module2/Expand...(Unnamed Layer* 2917) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.45971 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.082944 [07/20/2023-07:27:56] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:27:56] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 2917) [Shuffle]_output_and_/encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 64 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 32 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] =============== Computing costs for /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:27:56] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:27:56] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 2918) [Convolution]_output [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:27:56] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} [07/20/2023-07:27:56] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Int32() -> Float((* 256 N),256,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E9 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E9), Float((* 256 N),256,1), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(+ (+ E12 -5000) (+ E12 4999)) E14=(* E10 E10) E15=(* 256 E10) *************** [07/20/2023-07:27:56] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:00] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:00] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:01] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.197486 [07/20/2023-07:28:01] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 4.97322 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.197486 [07/20/2023-07:28:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:01] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Half((* 256 N),256,1), Half((* 256 N),256,1), Half((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Int32() -> Half((* 256 N),256,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E9 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E9), Half((* 256 N),256,1), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(+ (+ E12 -5000) (+ E12 4999)) E14=(* E10 E10) E15=(* 256 E10) *************** [07/20/2023-07:28:01] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:06] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:06] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:06] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.155063 [07/20/2023-07:28:06] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 5.85569 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.155063 [07/20/2023-07:28:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:06] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 4), Int32() -> Float((* 256 N),256,1), Half((* E10 E12),1:8,E12,E11) where E0=(CEIL_DIV (+ T -8) 4) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) 8) E12=(* E10 E11), Float((* 256 N),256,1), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(* 256 N) E11=(CEIL_DIV (+ T -8) 4) E12=(+ (+ E11 -5000) (+ E11 4999)) E13=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E14=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 E12 16 | -1 (MUL_ADD 2 E13 -1) 4 4 zeroIsPlaceholder))) 8) E15=(* E13 E14) E16=(* 32 E13) *************** [07/20/2023-07:28:06] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:12] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:12] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:12] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.165449 [07/20/2023-07:28:12] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module1/Expand...(Unnamed Layer* 3558) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 5.93906 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.165449 [07/20/2023-07:28:12] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:12] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 3558) [Shuffle]_output_and_/encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 64 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 32 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] =============== Computing costs for /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:12] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:12] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:12] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:12] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:12] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 3559) [Convolution]_output [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:12] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} [07/20/2023-07:28:12] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E9 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E9) -> Float((* 256 N),256,1), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(* E10 E10) E14=(* 256 E10) *************** [07/20/2023-07:28:12] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:14] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:14] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:14] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.100718 [07/20/2023-07:28:14] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.0176 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.100718 [07/20/2023-07:28:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:14] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Half((* 256 N),256,1), Half((* 256 N),256,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E9 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(CEIL_DIV (+ T -8) 4) E11=(* E9 E9) -> Half((* 256 N),256,1), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(* 256 N) E12=(CEIL_DIV (+ T -8) 4) E13=(* E10 E10) E14=(* 256 E10) *************** [07/20/2023-07:28:14] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:16] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:16] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:17] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.079872 [07/20/2023-07:28:17] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.3156 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.079872 [07/20/2023-07:28:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:17] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))), Float((* 256 N),256,1), Float((* 256 N),256,1), Half((* E10 E12),1:8,E12,E11) where E0=(CEIL_DIV (+ T -8) 4) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E11=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) 8) E12=(* E10 E11) -> Float((* 256 N),256,1), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 2))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(* 256 N) E11=(CEIL_DIV (+ T -8) 4) E12=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 2) E13=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E11 -5000) (+ E11 4999)) 16 | -1 (MUL_ADD 2 E12 -1) 4 4 zeroIsPlaceholder))) 8) E14=(* E12 E13) E15=(* 32 E12) *************** [07/20/2023-07:28:17] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:19] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:19] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:19] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0844069 [07/20/2023-07:28:19] [V] [TRT] {ForeignNode[/encoder/1/encoder/1/conv_module2/Expand...(Unnamed Layer* 3760) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.39154 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0844069 [07/20/2023-07:28:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:19] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 3760) [Shuffle]_output_and_/encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 64 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 32 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] =============== Computing costs for /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:19] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: /encoder/1/encoder/1/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:19] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 3761) [Convolution]_output [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1,256,256) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Float((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Float((* 8 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Float((* 8 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 8 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 256 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 256 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half((* 128 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) -> Half((* 128 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) E10=(* 128 E9) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:2,128,128) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 128 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:4,64,64) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 64 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Half(E9,1:16,E9,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) -> Half((* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:16,16,16) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 16 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)) *************** [07/20/2023-07:28:19] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} [07/20/2023-07:28:19] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Float((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 256 N),256,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Float((* 384 N),384,1), Float((* 384 N),384,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(CEIL_DIV (+ T -8) 8) E11=(* E9 E10), Float((* 384 N),384,1), Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(+ (CEIL_DIV (+ T -6) 2) -1) E3=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E2 (* (MAX (# 2 E4) E2) E5)) E7=(BROADCAST_SIZE E2 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV E14 2) E10=(* 256 N) E11=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E12=(* 384 N) E13=(CEIL_DIV (+ T -8) 8) E14=(BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) E15=(CEIL_DIV E14 4) E16=(+ (+ E13 -5000) (+ E13 4999)) E17=(* E15 E13) *************** [07/20/2023-07:28:19] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:25] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:25] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:25] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.202898 [07/20/2023-07:28:25] [V] [TRT] {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.13329 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.202898 [07/20/2023-07:28:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:25] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Half((* 256 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2), Half((* 256 N),256,1), Half((* 256 N),256,1), Half((* 256 N),256,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Half((* 384 N),384,1), Half((* 384 N),384,1), Half((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(CEIL_DIV (+ T -8) 8) E11=(* E9 E10), Half((* 384 N),384,1), Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(+ (CEIL_DIV (+ T -6) 2) -1) E3=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E2 (* (MAX (# 2 E4) E2) E5)) E7=(BROADCAST_SIZE E2 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV E14 2) E10=(* 256 N) E11=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E12=(* 384 N) E13=(CEIL_DIV (+ T -8) 8) E14=(BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) E15=(CEIL_DIV E14 4) E16=(+ (+ E13 -5000) (+ E13 4999)) E17=(* E15 E13) *************** [07/20/2023-07:28:25] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:31] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:31] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.15755 [07/20/2023-07:28:32] [V] [TRT] {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 6.50845 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.15755 [07/20/2023-07:28:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:32] [V] [TRT] *************** Autotuning format combination: Bool((* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))),1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))), Half((* 32 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 2)),1:8,32,32) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))), Float((* 256 N),256,1), Float((* 256 N),256,1), Float((* 256 N),256,1), Int32() -> Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Float((* 384 N),384,1), Float((* 384 N),384,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Half((* E0 E11),1:8,E11,E10) where E0=(CEIL_DIV (+ T -8) 8) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E0 -1) 4 4 zeroIsPlaceholder))) 8) E11=(* (CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E10), Float((* 384 N),384,1), Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(+ (CEIL_DIV (+ T -6) 2) -1) E3=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E2 (* (MAX (# 2 E4) E2) E5)) E7=(BROADCAST_SIZE E2 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 256 N) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 N) E12=(CEIL_DIV (+ T -8) 8) E13=(+ (+ E12 -5000) (+ E12 4999)) E14=(BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) E15=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 E13 16 | -1 (MUL_ADD 2 E12 -1) 4 4 zeroIsPlaceholder))) 8) E16=(* E17 E15) E17=(CEIL_DIV E14 4) *************** [07/20/2023-07:28:32] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:38] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:38] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.164571 [07/20/2023-07:28:39] [V] [TRT] {ForeignNode[/encoder/Slice_2...(Unnamed Layer* 4667) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 7.04371 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.164571 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447128 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.027843 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00422234 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00447128 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 96 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00440242 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0022211 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00440242 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1,384,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1,E9,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00412212 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0257707 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00401473 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00412212 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00443415 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00206482 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00443415 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00436059 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0248229 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00362774 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00436059 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 12 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 12 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 12 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437292 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0268922 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00380151 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00437292 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00434286 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0262339 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00371614 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00434286 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 192 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00437929 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.002023 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00437929 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 48 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447157 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00197503 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00447157 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 192 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 192 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 192 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00428585 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0265021 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00377712 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00428585 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00424995 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00206225 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00424995 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00415478 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0271848 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00379456 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00415478 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453029 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0253318 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00359602 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00453029 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420921 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00199456 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00420921 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00420464 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0264808 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00371462 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00420464 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Half((* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:16,24,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) -> Half(E9,1:16,E9,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00453314 [07/20/2023-07:28:39] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0260145 [07/20/2023-07:28:39] [V] [TRT] shuffle_between_(Unnamed Layer* 4667) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00366726 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00453314 [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:39] [V] [TRT] =============== Computing costs for /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_medium_nn_v1 Tactic: 0xf067e6205da31c2e Time: 3.97751 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x5deb29b7a8e275f7 Time: 3.51217 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_small_nn_v1 Tactic: 0x3f243c490d502deb Time: 3.21492 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x128_relu_small_nn_v1 Tactic: 0x503619c69ae500ff Time: 3.72063 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize128x32_threadsize64x4_general Tactic: 0x02aff33b8cd106c8 Time: 0.0101858 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xa9366041633a5135 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa9366041633a5135 Time: 2.29478 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xcb8a43f748d8a338 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xcb8a43f748d8a338 Time: 1.74387 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0x5aa723e0481da855 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x5aa723e0481da855 Time: 2.43632 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x8_threadsize32x4 Tactic: 0xd1a22ad13e727070 Time: 0.00793672 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0x40a12e3938221818 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x40a12e3938221818 Time: 2.05107 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xb0bf940d5e0f9f45 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xb0bf940d5e0f9f45 Time: 1.70906 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xd828f024626fa982 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd828f024626fa982 Time: 1.92736 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0x9d9fdb5fd9945f64 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x9d9fdb5fd9945f64 Time: 1.94662 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize32x8_threadsize32x4_general Tactic: 0x93ba18009b18a330 Time: 0.00620495 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f32f32_f32_f32_nchwkcrs_nchw Tactic: 0x0ab370a6aeef128c Time: 0.00426245 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xa8609adc4e0ceb90 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x32_relu_small_nn_v1 Tactic: 0xa8609adc4e0ceb90 Time: 3.15904 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xf64396b97c889179 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: ampere_scudnn_128x64_relu_medium_nn_v1 Tactic: 0xf64396b97c889179 Time: 3.59936 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0x12dbf7d94ee3696d which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x12dbf7d94ee3696d Time: 2.56 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x16_threadsize64x2 Tactic: 0x36688904578c3005 Time: 0.0190171 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_generic Tactic: 0xc9d0e04a5184cb3e Time: 0.00834514 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm70_xmma_convolution_depthwiseConv_fp32fp32_trt_kernel_fp32_TR_TS Tactic: 0x9934205e4f120728 Time: 0.00848457 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xa31d27de74b895ff which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xa31d27de74b895ff Time: 1.94752 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize128x8_threadsize128x1 Tactic: 0x966f5e7809fca289 Time: 0.0190314 [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize64x8_threadsize64x2_general Tactic: 0x00753944b0df80b7 Time: 0.00680533 [07/20/2023-07:28:39] [V] [TRT] Fast skip Tactic:0xbb8c3889c7eacd30 which exceed time limit during pre-run [07/20/2023-07:28:39] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize256x128x8_stage3_warpsize4x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xbb8c3889c7eacd30 Time: 5.34016 [07/20/2023-07:28:39] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.530873 seconds. Fastest Tactic: 0x0ab370a6aeef128c Time: 0.00426245 [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:39] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:28:39] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0ab370a6aeef128c [07/20/2023-07:28:39] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float(E9,1,E9,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:39] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x19b688348f983aa0 Time: 3.75457 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x16x32_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xcf8ea142095f02d2 Time: 1.69589 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0x92ed3100c35fc43e which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x92ed3100c35fc43e Time: 3.60755 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0x8014228ec08b4d49 which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x8014228ec08b4d49 Time: 10.9251 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0x1da91d865428f237 which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x1da91d865428f237 Time: 6.09178 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0x4fd3c46622e98342 which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x16x8_stage3_warpsize4x1x1_g1_ffma_aligna4_alignc4 Tactic: 0x4fd3c46622e98342 Time: 3.9977 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_wo_smem_f32f32_tf32f32_f32_nhwckrsc_nhwc_tilesize128x32x16_stage1_warpsize4x1x1_g1_tensor16x8x8_aligna4_alignc4 Tactic: 0xf231cca3335919a4 Time: 1.55531 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x7121ec1db3f80c67 Time: 2.84716 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize32x32x8_stage3_warpsize1x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x0a143be7a52f301a Time: 2.91343 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0x62835fce994f06dd which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage3_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x62835fce994f06dd Time: 3.81338 [07/20/2023-07:28:40] [V] [TRT] Fast skip Tactic:0xa6448a1e79f1ca6f which exceed time limit during pre-run [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm80_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x32x8_stage3_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xa6448a1e79f1ca6f Time: 4.17894 [07/20/2023-07:28:40] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.404391 seconds. Fastest Tactic: 0xf231cca3335919a4 Time: 1.55531 [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf231cca3335919a4 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize64x8_threadsize64x2_general_alignC4 Tactic: 0xf7bc7502ac7dff9b Time: 0.00734331 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize128x32_threadsize64x4_general_alignC4 Tactic: 0x5d176f6a3900f1fd Time: 0.00911857 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_convolution_trt_depthwiseFP32NHWC4_fp32nhwcx4_fp32nhwcx4_fp32kcrs Tactic: 0x2cac8ad6921b6398 Time: 0.00794717 [07/20/2023-07:28:40] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00969168 seconds. Fastest Tactic: 0xf7bc7502ac7dff9b Time: 0.00734331 [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf7bc7502ac7dff9b [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv1d_c1_k1_f16f16_f16_f16_nchwkcrs_nchw Tactic: 0x0eee0204592bd97f Time: 0.00554497 [07/20/2023-07:28:40] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00439451 seconds. Fastest Tactic: 0x0eee0204592bd97f Time: 0.00554497 [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:28:40] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x0eee0204592bd97f [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f16f16_f16_f16_ndhwcktrsc_ndhwc_tilesize64x16_threadsize64x2_general_alignC8 Tactic: 0x004bc40835df5b89 Time: 0.00622231 [07/20/2023-07:28:40] [V] [TRT] Tactic Name: sm50_xmma_convolution_depthwiseHMMA_FP16NHWCx8_TR_TS_STRIDEH_STRIDEW Tactic: 0x64275a11c9ed1722 Time: 0.00878118 [07/20/2023-07:28:40] [V] [TRT] /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0062179 seconds. Fastest Tactic: 0x004bc40835df5b89 Time: 0.00622231 [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module1/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:40] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x004bc40835df5b89 [07/20/2023-07:28:40] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 4668) [Convolution]_output [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0040994 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0261135 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00417056 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0040994 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00634971 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00214647 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00634971 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float(E9,1,E9,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float((* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1,384,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 384 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00655231 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0271375 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00386469 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00655231 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00447486 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00201516 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00447486 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Float((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00666265 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0267703 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00392807 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00666265 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Float((* 12 E9),E9:32,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Float((* 12 E9),E9:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 12 E9) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446529 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0239665 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00360917 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00446529 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 384 E9) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00446614 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0267916 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00374276 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00446614 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00624179 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00220699 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00624179 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half((* 384 E9),E9,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00625411 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00220888 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00625411 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half((* 192 E9),E9:2,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) -> Half((* 192 E9),E9:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(* 192 E9) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00427576 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0249417 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0037276 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00427576 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00438926 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00207408 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00438926 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:2,E9,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 192 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00459186 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0253074 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00355714 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00459186 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:4,E9,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 96 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00475502 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0266728 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0037158 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00475502 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 E10) E10=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00418926 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0021296 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00418926 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:8,E9,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00469574 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0251543 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00356984 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00469574 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Half(E9,1:16,E9,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) -> Half((* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:16,24,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(* 24 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00476404 [07/20/2023-07:28:40] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0254088 [07/20/2023-07:28:40] [V] [TRT] shuffle_after_(Unnamed Layer* 4668) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00364409 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00476404 [07/20/2023-07:28:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:40] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} [07/20/2023-07:28:40] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Float((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4), Float((* 384 N),384,1), Float((* 384 N),384,1), Float((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(CEIL_DIV (+ T -8) 8) E11=(* E9 E10) -> Float((* 384 N),384,1), Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E11=(* 384 N) E12=(CEIL_DIV (+ T -8) 8) E13=(* E10 E12) E14=(BROADCAST_SIZE E10 (* (MAX E3 E10) (MIN 1 E3))) *************** [07/20/2023-07:28:40] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:42] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:42] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:43] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0925989 [07/20/2023-07:28:43] [V] [TRT] {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.55381 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0925989 [07/20/2023-07:28:43] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:43] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Half((* 384 E9),E9,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4), Half((* 384 N),384,1), Half((* 384 N),384,1), Half((* (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E10 -5000) (+ E10 4999)) 16 | -1 (MUL_ADD 2 E10 -1) 4 4 zeroIsPlaceholder))) E11),E11,E9,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(CEIL_DIV (+ T -8) 8) E11=(* E9 E10) -> Half((* 384 N),384,1), Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E11=(* 384 N) E12=(CEIL_DIV (+ T -8) 8) E13=(* E10 E12) E14=(BROADCAST_SIZE E10 (* (MAX E3 E10) (MIN 1 E3))) *************** [07/20/2023-07:28:43] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:45] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:45] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:45] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0683642 [07/20/2023-07:28:45] [V] [TRT] {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.41829 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0683642 [07/20/2023-07:28:45] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:45] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Half((* 48 (CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4)),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))), Float((* 384 N),384,1), Float((* 384 N),384,1), Half((* E0 E11),1:8,E11,E10) where E0=(CEIL_DIV (+ T -8) 8) E1=(+ (CEIL_DIV (+ T -6) 2) -1) E2=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E3=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E4=(* (MIN E2 (MIN 1 (# 0 E3))) (MAX E2 (# 0 E3))) E5=(RESHAPE N E4 | N 1 E4) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E1 (* (MAX (# 2 E5) E1) E6)) E8=(BROADCAST_SIZE E1 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E0 -5000) (+ E0 4999)) 16 | -1 (MUL_ADD 2 E0 -1) 4 4 zeroIsPlaceholder))) 8) E11=(* (CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E10) -> Float((* 384 N),384,1), Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(* 384 N) E11=(CEIL_DIV (+ T -8) 8) E12=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E13=(CEIL_DIV (BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E11 -5000) (+ E11 4999)) 16 | -1 (MUL_ADD 2 E11 -1) 4 4 zeroIsPlaceholder))) 8) E14=(* E12 E13) *************** [07/20/2023-07:28:45] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:47] [V] [TRT] (foreignNode) Set user's cuda kernel library [07/20/2023-07:28:47] [V] [TRT] (foreignNode) [kqv_gemm_split]: kqv gemms split [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0695345 [07/20/2023-07:28:48] [V] [TRT] {ForeignNode[/encoder/2/encoder/0/conv_module2/Expand...(Unnamed Layer* 4869) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 2.64452 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0695345 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] =============== Computing costs for shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431596 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0326501 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0305782 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00431596 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 96 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00558048 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00218501 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00558048 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1,384,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Float(E11,1,E11,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00550875 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0450194 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0218978 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00550875 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00811022 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00216375 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00811022 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00845929 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0486823 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0219828 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00845929 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 12 E11),E11:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 12 E11),E11:32,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 12 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00803327 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0557471 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0218756 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00803327 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00914114 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.059645 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0132111 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00914114 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 192 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00714903 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00219647 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00714903 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 48 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00713317 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00224804 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00713317 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 192 E11),E11:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 192 E11),E11:2,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 192 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00733943 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0247025 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0127914 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00733943 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00431973 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00210304 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00431973 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0050746 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0431909 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0129489 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0050746 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00705741 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0483718 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0128107 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00705741 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00725806 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.00219661 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00725806 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711467 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0336997 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0131085 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00711467 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:16,24,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) -> Half(E11,1:16,E11,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00538091 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0504789 [07/20/2023-07:28:48] [V] [TRT] shuffle_between_(Unnamed Layer* 4869) [Shuffle]_output_and_/encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (Shuffle[0x8000000d]) profiling completed in 0.0151604 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00538091 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] =============== Computing costs for /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize128x32_threadsize64x4_general Tactic: 0x02aff33b8cd106c8 Time: 0.0101702 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x8_threadsize32x4 Tactic: 0xd1a22ad13e727070 Time: 0.00861445 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize32x8_threadsize32x4_general Tactic: 0x93ba18009b18a330 Time: 0.00617066 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize64x16_threadsize64x2 Tactic: 0x36688904578c3005 Time: 0.0190171 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_generic Tactic: 0xc9d0e04a5184cb3e Time: 0.00836089 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_direct_group_f32f32_f32_f32_nchwkcrs_nchw_3D_tilesize128x8_threadsize128x1 Tactic: 0x966f5e7809fca289 Time: 0.0190149 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ncdhwkctrs_ncdhw_tilesize64x8_threadsize64x2_general Tactic: 0x00753944b0df80b7 Time: 0.0067466 [07/20/2023-07:28:48] [V] [TRT] /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.0192246 seconds. Fastest Tactic: 0x93ba18009b18a330 Time: 0.00617066 [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:28:48] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x93ba18009b18a330 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1,E11,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float(E11,1,E11,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 E12) E12=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize64x8_threadsize64x2_general_alignC4 Tactic: 0xf7bc7502ac7dff9b Time: 0.00784114 [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f32f32_f32_f32_ndhwcktrsc_ndhwc_tilesize128x32_threadsize64x4_general_alignC4 Tactic: 0x5d176f6a3900f1fd Time: 0.00913286 [07/20/2023-07:28:48] [V] [TRT] /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00578391 seconds. Fastest Tactic: 0xf7bc7502ac7dff9b Time: 0.00784114 [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf7bc7502ac7dff9b [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CudnnConvolution[0x80000000]) [07/20/2023-07:28:48] [V] [TRT] CudnnConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 E12) E12=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] CaskConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) [07/20/2023-07:28:48] [V] [TRT] Tactic Name: sm50_xmma_fprop_conv3d_c1_k1_f16f16_f16_f16_ndhwcktrsc_ndhwc_tilesize64x16_threadsize64x2_general_alignC8 Tactic: 0x004bc40835df5b89 Time: 0.00614476 [07/20/2023-07:28:48] [V] [TRT] /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskConvolution[0x80000009]) profiling completed in 0.00274558 seconds. Fastest Tactic: 0x004bc40835df5b89 Time: 0.00614476 [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: /encoder/2/encoder/0/conv_module2/depthwise_conv/Conv (CaskFlattenConvolution[0x80000036]) [07/20/2023-07:28:48] [V] [TRT] CaskFlattenConvolution has no valid tactics for this config, skipping [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x004bc40835df5b89 [07/20/2023-07:28:48] [V] [TRT] =============== Computing costs for shuffle_after_(Unnamed Layer* 4870) [Convolution]_output [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00499452 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0455977 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0219935 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00499452 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00738651 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0024215 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00738651 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1,E11,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float((* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1,384,384) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 384 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00742857 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.048128 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0223701 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00742857 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 E12) E12=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00832711 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00247931 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00832711 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Float((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00915143 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0580693 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0222262 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00915143 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Float((* 12 E11),E11:32,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Float((* 12 E11),E11:32,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 12 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00846898 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0606537 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0223232 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00846898 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 384 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00840793 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0411063 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0132726 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00840793 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00630201 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00227782 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00630201 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 384 E11),E11,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00629048 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00221732 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00629048 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half((* 192 E11),E11:2,E11,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) -> Half((* 192 E11),E11:2,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(* 192 E11) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00520882 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0384 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0127068 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00520882 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 E12) E12=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00698231 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00235957 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00698231 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:2,E11,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:2,192,192) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 192 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00711423 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0339675 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0131187 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00711423 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:4,E11,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:4,96,96) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 96 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00563024 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0413257 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0130025 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00563024 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 E12) E12=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00624775 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.00238201 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00624775 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:8,E11,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.00554092 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0392423 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0129254 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.00554092 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Half(E11,1:16,E11,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) -> Half((* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:16,24,24) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(* 24 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0078388 [07/20/2023-07:28:48] [V] [TRT] Tactic: 0x0000000000000001 Time: 0.0438857 [07/20/2023-07:28:48] [V] [TRT] shuffle_after_(Unnamed Layer* 4870) [Convolution]_output (Shuffle[0x8000000d]) profiling completed in 0.0131724 seconds. Fastest Tactic: 0x0000000000000000 Time: 0.0078388 [07/20/2023-07:28:48] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/20/2023-07:28:48] [V] [TRT] =============== Computing costs for {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} [07/20/2023-07:28:48] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Float((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))), Float((* 384 N),384,1), Float((* 384 N),384,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Int32() -> Float((* 384 N),384,1), Float((* (BROADCAST_SIZE N (# 1 (RESHAPE (* E13 (* 4 E15)) E13 | 4 E15 E13 E13 zeroIsPlaceholder))) E16),E16,E12,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(BROADCAST_SIZE E9 (BROADCAST_SIZE E11 (* (MAX E10 E11) (MIN E10 (MIN 1 E11))))) E13=(BROADCAST_SIZE E11 E14) E14=(CEIL_DIV (+ T -8) 8) E15=(BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E14 -5000) (+ E14 4999)) 16 | -1 (MUL_ADD 2 E13 -1) 4 4 zeroIsPlaceholder))) E16=(* E12 E13), Float((* 384 N),384,1), Float((* 384 E12),E12,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(BROADCAST_SIZE E9 (BROADCAST_SIZE E11 (* (MAX E10 E11) (MIN E10 (MIN 1 E11))))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E11=(BROADCAST_SIZE E10 (* (MAX E3 E10) (MIN 1 E3))) E12=(* 384 N) E13=(CEIL_DIV (+ T -8) 8) E14=(BROADCAST_SIZE E10 (BROADCAST_SIZE E11 (* (MAX E3 E11) (MIN E3 (MIN 1 E11))))) E15=(BROADCAST_SIZE E11 E13) E16=(+ (+ E13 -5000) (+ E13 4999)) E17=(BROADCAST_SIZE N (# 0 (RESHAPE 1 E16 16 | -1 (MUL_ADD 2 E15 -1) 4 4 zeroIsPlaceholder))) E18=(* E14 E15) *************** [07/20/2023-07:28:48] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:50] [V] [TRT] Skipping tactic 0x0000000000000000 due to exception Autotuner: no tactics to implement operation [07/20/2023-07:28:50] [V] [TRT] {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 1.78796 seconds. Fastest Tactic: 0xd15ea5edd15ea5ed Time: inf [07/20/2023-07:28:50] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Half((* 384 E11),E11,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))), Half((* 384 N),384,1), Half((* 384 N),384,1), Half((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Int32() -> Half((* 384 N),384,1), Half((* (BROADCAST_SIZE N (# 1 (RESHAPE (* E13 (* 4 E15)) E13 | 4 E15 E13 E13 zeroIsPlaceholder))) E16),E16,E12,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(BROADCAST_SIZE E9 (BROADCAST_SIZE E11 (* (MAX E10 E11) (MIN E10 (MIN 1 E11))))) E13=(BROADCAST_SIZE E11 E14) E14=(CEIL_DIV (+ T -8) 8) E15=(BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E14 -5000) (+ E14 4999)) 16 | -1 (MUL_ADD 2 E13 -1) 4 4 zeroIsPlaceholder))) E16=(* E12 E13), Half((* 384 N),384,1), Half((* 384 E12),E12,1,1) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E12=(BROADCAST_SIZE E9 (BROADCAST_SIZE E11 (* (MAX E10 E11) (MIN E10 (MIN 1 E11))))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E11=(BROADCAST_SIZE E10 (* (MAX E3 E10) (MIN 1 E3))) E12=(* 384 N) E13=(CEIL_DIV (+ T -8) 8) E14=(BROADCAST_SIZE E10 (BROADCAST_SIZE E11 (* (MAX E3 E11) (MIN E3 (MIN 1 E11))))) E15=(BROADCAST_SIZE E11 E13) E16=(+ (+ E13 -5000) (+ E13 4999)) E17=(BROADCAST_SIZE N (# 0 (RESHAPE 1 E16 16 | -1 (MUL_ADD 2 E15 -1) 4 4 zeroIsPlaceholder))) E18=(* E14 E15) *************** [07/20/2023-07:28:50] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:28:55] [V] [TRT] Skipping tactic 0x0000000000000000 due to exception Autotuner: no tactics to implement operation [07/20/2023-07:28:55] [V] [TRT] {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 4.85051 seconds. Fastest Tactic: 0xd15ea5edd15ea5ed Time: inf [07/20/2023-07:28:55] [V] [TRT] *************** Autotuning format combination: Bool(E3,E3,1) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))), Half((* 48 (BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10)))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))), Float((* 384 N),384,1), Float((* 384 N),384,1), Float((* 48 (+ (+ E0 -5000) (+ E0 4999))),48,1) where E0=(CEIL_DIV (+ T -8) 8), Int32() -> Float((* 384 N),384,1), Half((* E12 E16),1:8,E16,E15) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(CEIL_DIV (+ T -8) 8) E12=(BROADCAST_SIZE E14 E11) E13=(BROADCAST_SIZE N (# 0 (RESHAPE 1 (+ (+ E11 -5000) (+ E11 4999)) 16 | -1 (MUL_ADD 2 E12 -1) 4 4 zeroIsPlaceholder))) E14=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) E15=(CEIL_DIV (BROADCAST_SIZE N (# 1 (RESHAPE (* E12 (* 4 E13)) E12 | 4 E13 E12 E12 zeroIsPlaceholder))) 8) E16=(* (BROADCAST_SIZE E9 (BROADCAST_SIZE E14 (* (MAX E10 E14) (MIN E10 (MIN 1 E14))))) E15), Float((* 384 N),384,1), Half((* 48 (BROADCAST_SIZE E9 (BROADCAST_SIZE E11 (* (MAX E10 E11) (MIN E10 (MIN 1 E11)))))),1:8,48,48) where E0=(+ (CEIL_DIV (+ T -6) 2) -1) E1=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E2=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E3=(* (MIN E1 (MIN 1 (# 0 E2))) (MAX E1 (# 0 E2))) E4=(RESHAPE N E3 | N 1 E3) E5=(MIN 1 (# 2 E4)) E6=(BROADCAST_SIZE E0 (* (MAX (# 2 E4) E0) E5)) E7=(BROADCAST_SIZE E0 (BROADCAST_SIZE E6 (* E5 (MAX (# 2 E4) E6)))) E8=(BROADCAST_SIZE E7 (* E5 (MAX (# 2 E4) E7))) E9=(CEIL_DIV (BROADCAST_SIZE E7 (BROADCAST_SIZE E8 (* E5 (MAX (# 2 E4) E8)))) 4) E10=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E3) E3) 4))) E11=(BROADCAST_SIZE E9 (* (MAX E10 E9) (MIN 1 E10))) where E0=(MAX 0 (# 0 (VALUE /ReduceMax_output_0))) E1=(GATHER (# 0 (VALUE /ReduceMax_output_0)) 1 | (EQUAL -1 (# 0 (VALUE /ReduceMax_output_0)))) E2=(* (MIN E0 (MIN 1 (# 0 E1))) (MAX E0 (# 0 E1))) E3=(MAX 0 (- 0 (FLOOR_DIV (- (MIN 0 E2) E2) 4))) E4=(+ (CEIL_DIV (+ T -6) 2) -1) E5=(RESHAPE N E2 | N 1 E2) E6=(MIN 1 (# 2 E5)) E7=(BROADCAST_SIZE E4 (* (MAX (# 2 E5) E4) E6)) E8=(BROADCAST_SIZE E4 (BROADCAST_SIZE E7 (* E6 (MAX (# 2 E5) E7)))) E9=(BROADCAST_SIZE E8 (* E6 (MAX (# 2 E5) E8))) E10=(CEIL_DIV (BROADCAST_SIZE E8 (BROADCAST_SIZE E9 (* E6 (MAX (# 2 E5) E9)))) 4) E11=(* 384 N) E12=(CEIL_DIV (+ T -8) 8) E13=(BROADCAST_SIZE E10 (* (MAX E3 E10) (MIN 1 E3))) E14=(+ (+ E12 -5000) (+ E12 4999)) E15=(BROADCAST_SIZE E13 E12) E16=(BROADCAST_SIZE N (# 0 (RESHAPE 1 E14 16 | -1 (MUL_ADD 2 E15 -1) 4 4 zeroIsPlaceholder))) E17=(CEIL_DIV (BROADCAST_SIZE N (# 1 (RESHAPE (* E15 (* 4 E16)) E15 | 4 E16 E15 E15 zeroIsPlaceholder))) 8) E18=(* E19 E17) E19=(BROADCAST_SIZE E10 (BROADCAST_SIZE E13 (* (MAX E3 E13) (MIN E3 (MIN 1 E13))))) *************** [07/20/2023-07:28:55] [V] [TRT] --------------- Timing Runner: {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) [07/20/2023-07:29:00] [V] [TRT] Skipping tactic 0x0000000000000000 due to exception Autotuner: no tactics to implement operation [07/20/2023-07:29:00] [V] [TRT] {ForeignNode[/encoder/2/encoder/1/conv_module1/Expand...(Unnamed Layer* 5510) [Shuffle]]} (Myelin[0x80000023]) profiling completed in 4.90189 seconds. Fastest Tactic: 0xd15ea5edd15ea5ed Time: inf [07/20/2023-07:29:00] [V] [TRT] Deleting timing cache: 207 entries, served 222 hits since creation. &&&& FAILED TensorRT.trtexec [TensorRT v8601] # trtexec --onnx=./encoder-epoch-99-avg-1.onnx --minShapes=x:1x16x80,x_lens:1 --optShapes=x:4x512x80,x_lens:4 --maxShapes=x:8x2000x80,x_lens:8 --fp16 --skipInference --verbose --saveEngine=./encoder.trt90.plan